The short answer
On the seven classic English sets of the Open ASR Leaderboard, scored with the leaderboard's code on the full test sets, Phonon-2.5 English averages 4.82 % word error, the 25-language Phonon-2.5 5.06 % and Phonon-2 5.21 %.
On the nine public sets of the leaderboard's current protocol, Phonon-2.5 English scores 5.60 % and Phonon-2.5 5.70 % (Fermion Research run of 2026-10-28). Phonon-2's leaderboard row on the same nine sets was 6.25 %.
Phonon-2.5 English and Phonon-2.5 are listed on the Open ASR Leaderboard since 2026-11-13 (board version 1.16.0), with board averages of 7.05 % and 7.16 % over its default columns (seven public English sets, without LibriSpeech, plus two private sets the maintainers run) and RTFx of 2,110 and 1,898 on the maintainers' GPU. The board removed Phonon-2's row on 2026-11-20.
Seven English sets
Word error rate, %, lower is better. † marks the Open ASR Leaderboard's published row; the other rows were scored with the leaderboard's code on the full test sets, with Earnings-22 as the leaderboard's chunked set. Table as published in the Phonon-2.5 release post on 2026-10-22.
| Model | Size | LS clean | LS other | AMI | Earnings-22 | GigaSpeech | SPGISpeech | VoxPopuli | Average |
|---|---|---|---|---|---|---|---|---|---|
| Phonon-2.5 English | 158 MB | 1.64 | 3.56 | 8.76 | 6.22 | 7.99 | 3.31 | 2.28 | 4.82 |
| Phonon-2.5 (25 languages) | 156 MB | 1.60 | 3.41 | 9.12 | 6.72 | 8.04 | 3.31 | 3.23 | 5.06 |
| Phonon-2 | 164 MB | 1.72 | 3.92 | 9.37 | 6.96 | 8.35 | 3.70 | 2.46 | 5.21 |
| Underdog Bark 3.0 | 163 MB | 1.89 | 4.08 | 7.82 | 7.05 | 7.95 | 3.72 | 2.05 | 4.94 |
| Parakeet TDT 0.6B v3 † | 2,508 MB | 1.52 | 3.13 | 9.42 | 5.85 | 7.99 | 3.63 | 3.19 | 4.96 |
| Parakeet Redux | 178 MB | 1.94 | 4.35 | 9.16 | 7.90 | 8.62 | 4.01 | 3.87 | 5.69 |
Nine English sets (current protocol)
The leaderboard's current English protocol adds URGENT24 and Monsoon en-IN to the seven sets. Fermion Research ran it with the leaderboard's own code on the full sets on 2026-10-28. Both models are now on the board, which since November 2026 leaves LibriSpeech out of its default average and adds two private sets, so the board's averages (7.05 % and 7.16 %) cover different sets from the table below. Phonon-2's average on the same nine sets was its leaderboard row, 6.25 %.
The multilingual Phonon-2.5 is slightly lower than Phonon-2.5 English on URGENT24, Monsoon en-IN, both LibriSpeech sets and SPGISpeech; Phonon-2.5 English is lower on AMI, Earnings-22, GigaSpeech and VoxPopuli, and on the average. URGENT24, speech with noise and distortions, is the hardest set for both.
| Model | AMI | Earnings-22 | GigaSpeech | LS clean | LS other | SPGISpeech | URGENT24 | Monsoon en-IN | VoxPopuli | Average |
|---|---|---|---|---|---|---|---|---|---|---|
| Phonon-2.5 English (158 MB) | 8.69 | 6.18 | 7.99 | 1.64 | 3.56 | 3.32 | 12.32 | 4.44 | 2.30 | 5.60 |
| Phonon-2.5 (156 MB, 25 languages) | 8.99 | 6.68 | 8.01 | 1.61 | 3.49 | 3.30 | 11.88 | 4.29 | 3.01 | 5.70 |
Context from the leaderboard
Other models' seven-set averages from the Open ASR Leaderboard snapshot of 2026-09-25, for comparison with the seven-set numbers above only. Several larger open models and closed APIs have lower averages than Phonon-2.5 English; among models under 200 MB on that snapshot, Phonon-2 had the lowest average.
| Model | Size | Seven-set average WER % |
|---|---|---|
| zoom/scribe_v2_pro (closed API) | n/a | 3.68 |
| elevenlabs/scribe_v2 (closed API) | n/a | 4.06 |
| HojoAI/Hojo-ASR-V1 | 10,360 MB | 4.29 |
| Qwen/Qwen3-ASR-1.7B-hf | 4,080 MB | 4.43 |
| nvidia/parakeet-tdt-0.6b-v2 | 2,472 MB | 4.82 |
| nvidia/parakeet-tdt-0.6b-v3 | 2,508 MB | 4.96 |
| Phonon-2 | 164 MB | 5.21 |
| openai/whisper-large-v3 | 3,090 MB | 6.04 |
| openai/whisper-large-v3-turbo | 1,618 MB | 6.58 |
| abr-ai/niagara-84m-batch.en | 168 MB | 7.27 |
Questions
- What is Phonon-2.5 English's word error rate?
- 4.82 % averaged over the seven classic Open ASR Leaderboard English sets, and 5.60 % over the nine sets of the current protocol, both scored with the leaderboard's code on the full test sets.
- Is Phonon-2.5 on the Open ASR Leaderboard?
- Yes, since 2026-11-13. The board averages 7.05 % for Phonon-2.5 English and 7.16 % for Phonon-2.5 over its default columns, which leave out LibriSpeech and include two private sets.
- Is the 25-language Phonon-2.5 good at English?
- It averages 5.06 % on the seven sets, lower than Phonon-2's 5.21 %. Phonon-2.5 English is lower still at 4.82 %.
- Which English set is hardest for Phonon?
- URGENT24, speech with noise and distortions: 11.88 % for Phonon-2.5 and 12.32 % for Phonon-2.5 English. Among the classic seven, AMI meeting recordings is the hardest.
- Do any models score lower than Phonon-2.5 English?
- Yes. On the 2026-09-25 leaderboard snapshot, several larger open models and closed APIs have lower seven-set averages, the lowest being 3.68 % for a closed API.
- Why do the seven-set and nine-set averages differ?
- They average different sets. The nine-set protocol adds URGENT24 and Monsoon en-IN, and URGENT24's noisy audio raises the average.
Related
Sources and method
- Seven-set English numbers: Phonon-2.5 release post Table 2, 2026-10-22; Open ASR Leaderboard scoring code on the full test sets (Earnings-22 = the leaderboard's chunked set); † = the Open ASR Leaderboard's published row.
- Nine-set English numbers: Fermion Research measurement, 2026-10-28, Open ASR Leaderboard code, full test sets; Phonon-2 = its leaderboard row (removed from the board 2026-11-20). Official board rows: Open ASR Leaderboard version 1.16.2, read 2026-11-21.
- Other models, seven English sets: Open ASR Leaderboard, seven English sets, snapshot 2026-09-25.
Canonical: https://www.fermionresearch.com/speech/english-benchmark-results/