---
title: "Self-host a speech-to-text server with an OpenAI-compatible endpoint"
description: "Run a 156 MB open speech model as a transcription server on CPU, Apple silicon or NVIDIA GPU. One command exposes POST /v1/audio/transcriptions; Docker images for CPU and CUDA."
canonical: "https://www.fermionresearch.com/models/phonon-2-5/self-host/"
source: "Fermion Research"
---

Phonon/facts checked 13 November 2026

# Self-host a speech-to-text server with an OpenAI-compatible endpoint

fermion serve turns any Phonon model into a local transcription server with the same route shape as OpenAI's audio endpoint. No GPU required.

[Speech recognition docs](https://www.fermionresearch.com/docs/speech/)

## One command

Install the package and serve a model. The audio routes mount in place of the chat routes.

```text
pip install fermion-research
fermion serve phonon-2.5
# Listening on http://127.0.0.1:8000

curl -s http://127.0.0.1:8000/v1/audio/transcriptions -F file=@clip.wav
# {"text": "The transcript."}
```

## Routes

- POST /v1/audio/transcriptions: one-shot file transcription; longer audio is handled in chunks.
- GET /v1/audio/stream: live transcription over a standard WebSocket (see the streaming docs).
- Health endpoint stays unauthenticated; every /v1 route takes a bearer token when --api-key is set.

## Beyond localhost

A non-loopback bind requires an API key; without one the server refuses to start.

```text
fermion serve phonon-2.5 --host 0.0.0.0 --port 8000 --api-key "$FERMION_API_KEY"
```

## Docker

Two images serve the same endpoint as fermion serve, so a client written against one works against the other.

```text
docker run --rm -p 8000:8000 -v phonon-cache:/home/phonon/.cache ghcr.io/fermionresearch/phonon-cpu:2.0.12 serve phonon-2.5
docker run --rm --gpus all -p 8000:8000 -v phonon-cache:/home/phonon/.cache ghcr.io/fermionresearch/phonon-cuda:1.0.11 serve phonon-2.5
```

## Which model

- phonon-2.5: 25 languages, 156 MB, 11.71 % average FLEURS word error.
- phonon-2.5-en: English only, 158 MB, 4.82 % on the seven Open ASR Leaderboard sets.
- phonon-2: the earlier English model, 164 MB, 5.21 %; the one with a Core ML package for the Apple Neural Engine.

## Throughput

Published Phonon-2 figures, which Phonon-2.5 shares in size and architecture: 143 times realtime on eight AMD Zen 5 cores, 174 times realtime on an M5 MacBook Air GPU, 6,680 times realtime batched on an H100. An eight-core CPU box therefore clears more than a hundred hours of audio per hour.

## Questions

## Related

- [Speech streaming docs](https://www.fermionresearch.com/docs/speech-streaming/)
- [Phonon-2.5](https://www.fermionresearch.com/models/phonon-2-5/)
- [Open speech-to-text models under 200 MB, compared](https://www.fermionresearch.com/models/phonon-2-5/small-models/)

## Sources and method

- Commands, routes and flags: /docs/speech/ and /docs/serve/ (fermion-research 0.2.15, 2026-10-24).
- Throughput: Phonon-2 model page, published figures.

Canonical: https://www.fermionresearch.com/models/phonon-2-5/self-host/

Source: [https://www.fermionresearch.com/models/phonon-2-5/self-host/](https://www.fermionresearch.com/models/phonon-2-5/self-host/)
