---
title: "The Open ASR Leaderboard and the Phonon models"
description: "What the Hugging Face Open ASR Leaderboard measures, how word error is normalised, and the Phonon rows: Phonon-2.5 and Phonon-2.5 English listed since November 2026."
canonical: "https://www.fermionresearch.com/models/phonon-2-5/open-asr-leaderboard/"
source: "Fermion Research"
---

Phonon/facts checked 21 November 2026

# The Open ASR Leaderboard and the Phonon models

The leaderboard is the public reference for English speech recognition accuracy. This page explains its protocol and lists the Phonon numbers scored with its code.

[Open ASR Leaderboard on Hugging Face](https://huggingface.co/spaces/hf-audio/open_asr_leaderboard)

## What it measures

The Open ASR Leaderboard, run by Hugging Face, scores speech models on public English test sets (LibriSpeech clean and other, AMI, Earnings-22, GigaSpeech, SPGISpeech, VoxPopuli, and newer additions) and reports word error rate per set, an average, and RTFx, the inverse realtime factor. The maintainers run every model with one evaluation harness and one text normaliser, so rows are comparable.

Submissions are pull requests to the open_asr_leaderboard repository with an evaluation script; the maintainers run the official job.

## Phonon rows

- Phonon-2.5 English (158 MB) is listed with a board average of 7.05 % and RTFx 2,110. Our seven-set average with the leaderboard's code is 4.82 %.
- Phonon-2.5 (156 MB, 25 languages) is listed with a board average of 7.16 % and RTFx 1,898. Our seven-set average is 5.06 %.
- Phonon-2 (164 MB, English) had a row until 2026-11-20, when the board removed it. Our seven-set average is 5.21 %.

The board's printed average can differ from a seven-set average because the board includes additional sets; the numbers here state which sets they cover.

| Model | Size | LS clean | LS other | AMI | Earnings-22 | GigaSpeech | SPGISpeech | VoxPopuli | Average |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| Phonon-2.5 English | 158 MB | 1.64 | 3.56 | 8.76 | 6.22 | 7.99 | 3.31 | 2.28 | 4.82 |
| Phonon-2.5 (25 languages) | 156 MB | 1.60 | 3.41 | 9.12 | 6.72 | 8.04 | 3.31 | 3.23 | 5.06 |
| Phonon-2 | 164 MB | 1.72 | 3.92 | 9.37 | 6.96 | 8.35 | 3.70 | 2.46 | 5.21 |

## Normalisation

The leaderboard applies the Whisper English text normaliser before scoring: case, punctuation, number and spelling variants are folded, so a transcript is not penalised for writing 'twenty' where the reference has '20'. Multilingual rows use a different normaliser that keeps diacritics, which is why FLEURS numbers on the Phonon-2.5 page, scored with our own harness, are not the same thing as leaderboard cells.

## Questions

## Related

- [Open speech-to-text models under 200 MB, compared](https://www.fermionresearch.com/models/phonon-2-5/small-models/)
- [Phonon-2.5 English](https://www.fermionresearch.com/models/phonon-2-5-english/)

## Sources and method

- Leaderboard protocol: github.com/huggingface/open_asr_leaderboard README, read 2026-11-13.
- Phonon numbers: Phonon-2.5 release post Table 2 (2026-10-22). Board rows: Open ASR Leaderboard version 1.16.2, read 2026-11-21 (Phonon-2.5 added in version 1.16.0 on 2026-11-13; Phonon-2 removed in 1.16.2 on 2026-11-20).

Canonical: https://www.fermionresearch.com/models/phonon-2-5/open-asr-leaderboard/

Source: [https://www.fermionresearch.com/models/phonon-2-5/open-asr-leaderboard/](https://www.fermionresearch.com/models/phonon-2-5/open-asr-leaderboard/)
