---
title: "Whisper alternatives: open models, faster runtimes and APIs"
description: "Alternatives to OpenAI Whisper by need: lower English error, smaller downloads, faster Whisper runtimes or hosted APIs. Measured numbers, and when Whisper wins."
canonical: "https://www.fermionresearch.com/speech/whisper-alternatives/"
source: "Fermion Research"
---

Speech recognition/facts checked 13 November 2026

# Whisper alternatives: open models, faster runtimes and APIs

Whisper made open speech recognition practical, and it is still the widest-language open model. Newer open models beat it on English accuracy and size; some tools keep the Whisper model and only make it faster.

[Phonon-2.5 downloads and benchmarks](https://www.fermionresearch.com/models/phonon-2-5/)

## The short answer

If you want lower English error than Whisper, Qwen3-ASR 1.7B (4.43 % word error), Parakeet TDT 0.6B v2 (4.82 %) and Phonon-2.5 English (4.82 %) all average below Whisper large-v3 (6.04 %) on the seven Open ASR Leaderboard English sets. If you want to keep Whisper but run it faster, use faster-whisper, whisper.cpp, mlx-whisper or WhisperKit. If you need Whisper's 99 languages or its translation to English, stay with Whisper.

For European languages from a small download, Phonon-2.5 covers 25 languages in 156 MB and averages 11.71 % word error on FLEURS, against 53.71 % for Whisper base, which is about the same size, on the same 25 sets.

## Alternative models compared with Whisper

English seven-set word error in %, lower is better. Phonon rows are our runs with the leaderboard's scoring code; the others are the leaderboard snapshot of 2026-09-25.

| Model | Open weights | Size | Languages | English 7-set WER |
| --- | --- | --- | --- | --- |
| Whisper large-v3 (reference) | yes | 3,090 MB | 99 | 6.04 |
| Whisper large-v3-turbo (reference) | yes | 1,618 MB | 99 | 6.58 |
| Qwen3-ASR 1.7B | yes | 4,080 MB | 30 and 22 Chinese dialects | 4.43 |
| Parakeet TDT 0.6B v2 | yes | 2,472 MB | English | 4.82 |
| Phonon-2.5 English | yes | 158 MB | English | 4.82 |
| Cohere Transcribe 03-2026 | yes | 4,000 MB | 14 | 4.85 |
| Parakeet TDT 0.6B v3 | yes | 2,508 MB | 25 | 4.96 |
| Phonon-2.5 | yes | 156 MB | 25 | 5.06 |
| Canary 1B v2 | yes | 3,916 MB | 25, with translation | 5.81 |
| ElevenLabs Scribe v2 | no, API | n/a | 90+ | 4.06 |
| AssemblyAI Universal-3.5 Pro | no, API | n/a | 18 | 4.46 |
| Meta muse-voice-transcribe | no, API | n/a | see provider | 4.93 |

## Keep Whisper, run it faster

These tools run the same Whisper weights, so accuracy stays the same and speed or memory changes:

- faster-whisper: a reimplementation on CTranslate2; its README says up to 4 times faster than openai/whisper for the same accuracy, on CPU and NVIDIA GPU. pip install faster-whisper.
- whisper.cpp: C/C++ with Metal on Apple silicon, the Neural Engine for the encoder through Core ML, integer quantisation, and bindings for more than ten languages.
- mlx-whisper: Whisper on the GPU of an Apple silicon Mac from Python.
- WhisperKit: Whisper in Swift apps on Apple silicon, with a Homebrew CLI.

Whisper's own README lists turbo (809 M parameters) at about 8 times the speed of large on an A100, and notes that turbo is not trained for translation.

## When Whisper is still the right choice

- Your audio is in a language the alternatives do not cover. Whisper's card lists 99 languages; Phonon-2.5 covers 25 European languages and Qwen3-ASR 30.
- You need speech translated to English text. Whisper large-v3 and medium translate; turbo, Parakeet and Phonon do not. Canary 1B v2 translates between English and 24 languages.
- Your pipeline already depends on Whisper's segment output or prompt behaviour and the error rate is acceptable.

## Switching from the Whisper API

OpenAI's transcription route is POST /v1/audio/transcriptions. fermion serve exposes the same route shape for the Phonon models on your own machine, so an OpenAI client can point its base URL at it. Hosted Whisper is also sold by several providers; the speech-to-text API cost guide lists dated prices.

```text
pip install fermion-research
fermion serve phonon-2.5
curl -s http://127.0.0.1:8000/v1/audio/transcriptions -F file=@clip.wav
```

## Questions

## Related

- [Phonon-2.5 vs Whisper](https://www.fermionresearch.com/models/phonon-2-5/vs-whisper/)
- [Best open-source speech-to-text models](https://www.fermionresearch.com/speech/best-open-source-speech-to-text-model/)
- [Speech-to-text API cost](https://www.fermionresearch.com/speech/speech-to-text-api-cost/)
- [Self-host a speech-to-text server](https://www.fermionresearch.com/models/phonon-2-5/self-host/)

## Sources and method

- Rival English averages: Open ASR Leaderboard, seven English sets (LibriSpeech clean and other, AMI, Earnings-22, GigaSpeech, SPGISpeech, VoxPopuli), snapshot 2026-09-25.
- Phonon English averages: Fermion Research measurement with the Open ASR Leaderboard's scoring code on the full seven test sets (Phonon-2.5 release post, 2026-10-22).
- FLEURS numbers: Fermion Research measurement on the full FLEURS test set of each language, one scoring code and normalisation for every model (Phonon-2.5 release post, 2026-10-22).
- Whisper sizes, languages, turbo notes: github.com/openai/whisper and huggingface.co/openai/whisper-large-v3-turbo, read 2026-11-13.
- faster-whisper: github.com/SYSTRAN/faster-whisper; whisper.cpp: github.com/ggml-org/whisper.cpp; WhisperKit: github.com/argmaxinc/WhisperKit; read 2026-11-13.
- Languages: model cards of Qwen3-ASR 1.7B, Parakeet TDT 0.6B v2 and v3, Cohere Transcribe, Canary 1B v2 on Hugging Face; elevenlabs.io/pricing/api; assemblyai.com/pricing; read 2026-11-13.

Canonical: https://www.fermionresearch.com/speech/whisper-alternatives/

Source: [https://www.fermionresearch.com/speech/whisper-alternatives/](https://www.fermionresearch.com/speech/whisper-alternatives/)
