---
title: "English speech recognition benchmark results"
description: "Phonon-2.5 English averages 4.82 % word error on the seven Open ASR Leaderboard English sets and 5.60 % on the current nine, scored with its code."
canonical: "https://www.fermionresearch.com/speech/english-benchmark-results/"
source: "Fermion Research"
---

Speech recognition/facts checked 21 November 2026

# English speech recognition benchmark results

Per-set word error rates for Phonon-2.5 English, Phonon-2.5 and Phonon-2 on the Open ASR Leaderboard's English test sets, with the leaderboard's own rows for context.

[Phonon-2.5 English](https://www.fermionresearch.com/models/phonon-2-5-english/)158 MB, open weights on Hugging Face.

## The short answer

On the seven classic English sets of the Open ASR Leaderboard, scored with the leaderboard's code on the full test sets, Phonon-2.5 English averages 4.82 % word error, the 25-language Phonon-2.5 5.06 % and Phonon-2 5.21 %.

On the nine public sets of the leaderboard's current protocol, Phonon-2.5 English scores 5.60 % and Phonon-2.5 5.70 % (Fermion Research run of 2026-10-28). Phonon-2's leaderboard row on the same nine sets was 6.25 %.

Phonon-2.5 English and Phonon-2.5 are listed on the Open ASR Leaderboard since 2026-11-13 (board version 1.16.0), with board averages of 7.05 % and 7.16 % over its default columns (seven public English sets, without LibriSpeech, plus two private sets the maintainers run) and RTFx of 2,110 and 1,898 on the maintainers' GPU. The board removed Phonon-2's row on 2026-11-20.

## Seven English sets

Word error rate, %, lower is better. † marks the Open ASR Leaderboard's published row; the other rows were scored with the leaderboard's code on the full test sets, with Earnings-22 as the leaderboard's chunked set. Table as published in the Phonon-2.5 release post on 2026-10-22.

| Model | Size | LS clean | LS other | AMI | Earnings-22 | GigaSpeech | SPGISpeech | VoxPopuli | Average |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| Phonon-2.5 English | 158 MB | 1.64 | 3.56 | 8.76 | 6.22 | 7.99 | 3.31 | 2.28 | 4.82 |
| Phonon-2.5 (25 languages) | 156 MB | 1.60 | 3.41 | 9.12 | 6.72 | 8.04 | 3.31 | 3.23 | 5.06 |
| Phonon-2 | 164 MB | 1.72 | 3.92 | 9.37 | 6.96 | 8.35 | 3.70 | 2.46 | 5.21 |
| Underdog Bark 3.0 | 163 MB | 1.89 | 4.08 | 7.82 | 7.05 | 7.95 | 3.72 | 2.05 | 4.94 |
| Parakeet TDT 0.6B v3 † | 2,508 MB | 1.52 | 3.13 | 9.42 | 5.85 | 7.99 | 3.63 | 3.19 | 4.96 |
| Parakeet Redux | 178 MB | 1.94 | 4.35 | 9.16 | 7.90 | 8.62 | 4.01 | 3.87 | 5.69 |

## Nine English sets (current protocol)

The leaderboard's current English protocol adds URGENT24 and Monsoon en-IN to the seven sets. Fermion Research ran it with the leaderboard's own code on the full sets on 2026-10-28. Both models are now on the board, which since November 2026 leaves LibriSpeech out of its default average and adds two private sets, so the board's averages (7.05 % and 7.16 %) cover different sets from the table below. Phonon-2's average on the same nine sets was its leaderboard row, 6.25 %.

The multilingual Phonon-2.5 is slightly lower than Phonon-2.5 English on URGENT24, Monsoon en-IN, both LibriSpeech sets and SPGISpeech; Phonon-2.5 English is lower on AMI, Earnings-22, GigaSpeech and VoxPopuli, and on the average. URGENT24, speech with noise and distortions, is the hardest set for both.

| Model | AMI | Earnings-22 | GigaSpeech | LS clean | LS other | SPGISpeech | URGENT24 | Monsoon en-IN | VoxPopuli | Average |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| Phonon-2.5 English (158 MB) | 8.69 | 6.18 | 7.99 | 1.64 | 3.56 | 3.32 | 12.32 | 4.44 | 2.30 | 5.60 |
| Phonon-2.5 (156 MB, 25 languages) | 8.99 | 6.68 | 8.01 | 1.61 | 3.49 | 3.30 | 11.88 | 4.29 | 3.01 | 5.70 |

## Context from the leaderboard

Other models' seven-set averages from the Open ASR Leaderboard snapshot of 2026-09-25, for comparison with the seven-set numbers above only. Several larger open models and closed APIs have lower averages than Phonon-2.5 English; among models under 200 MB on that snapshot, Phonon-2 had the lowest average.

| Model | Size | Seven-set average WER % |
| --- | --- | --- |
| zoom/scribe_v2_pro (closed API) | n/a | 3.68 |
| elevenlabs/scribe_v2 (closed API) | n/a | 4.06 |
| HojoAI/Hojo-ASR-V1 | 10,360 MB | 4.29 |
| Qwen/Qwen3-ASR-1.7B-hf | 4,080 MB | 4.43 |
| nvidia/parakeet-tdt-0.6b-v2 | 2,472 MB | 4.82 |
| nvidia/parakeet-tdt-0.6b-v3 | 2,508 MB | 4.96 |
| Phonon-2 | 164 MB | 5.21 |
| openai/whisper-large-v3 | 3,090 MB | 6.04 |
| openai/whisper-large-v3-turbo | 1,618 MB | 6.58 |
| abr-ai/niagara-84m-batch.en | 168 MB | 7.27 |

## Questions

## Related

- [Phonon and the Open ASR Leaderboard](https://www.fermionresearch.com/models/phonon-2-5/open-asr-leaderboard/)
- [The Open ASR Leaderboard, explained](https://www.fermionresearch.com/glossary/open-asr-leaderboard/)
- [How Fermion Research measures speech models](https://www.fermionresearch.com/speech/benchmark-methodology/)
- [Phonon-2.5 English](https://www.fermionresearch.com/models/phonon-2-5-english/)
- [Open speech-to-text models under 200 MB](https://www.fermionresearch.com/models/phonon-2-5/small-models/)

## Sources and method

- Seven-set English numbers: Phonon-2.5 release post Table 2, 2026-10-22; Open ASR Leaderboard scoring code on the full test sets (Earnings-22 = the leaderboard's chunked set); † = the Open ASR Leaderboard's published row.
- Nine-set English numbers: Fermion Research measurement, 2026-10-28, Open ASR Leaderboard code, full test sets; Phonon-2 = its leaderboard row (removed from the board 2026-11-20). Official board rows: Open ASR Leaderboard version 1.16.2, read 2026-11-21.
- Other models, seven English sets: Open ASR Leaderboard, seven English sets, snapshot 2026-09-25.

Canonical: https://www.fermionresearch.com/speech/english-benchmark-results/

Source: [https://www.fermionresearch.com/speech/english-benchmark-results/](https://www.fermionresearch.com/speech/english-benchmark-results/)
