---
title: "The FLEURS benchmark"
description: "FLEURS is a public Google speech dataset of read sentences in 102 languages, about 12 hours per language. What it contains and how to read FLEURS results."
canonical: "https://www.fermionresearch.com/glossary/fleurs-benchmark/"
source: "Fermion Research"
---

Glossary/facts checked 13 November 2026

# The FLEURS benchmark

The standard public test set for multilingual speech recognition: where it comes from, what it measures well, and what it does not.

[Phonon-2.5 FLEURS results](https://www.fermionresearch.com/speech/fleurs-results-25-languages/)

## The short answer

FLEURS (Few-shot Learning Evaluation of Universal Representations of Speech) is a public speech dataset with read sentences in 102 languages and about 12 hours of speech per language. It was released by Google researchers in 2022 (Conneau et al., arXiv 2205.12446) and is widely used to compare multilingual speech recognition models language by language.

It is built on the FLoRes-101 machine translation benchmark, so the same sentences are read in every language. That makes per-language results line up better than on datasets collected separately in each language.

## FLEURS at a glance

Facts from the FLEURS paper and its Hugging Face dataset card, read 2026-11-13.

| Property | FLEURS |
| --- | --- |
| Languages | 102, from more than 10 language families |
| Speech per language | About 12 hours of supervision |
| Source sentences | FLoRes-101 (n-way parallel: the same sentences in every language) |
| Speaking style | Read speech |
| Splits | train, validation and test for each language |
| Audio | 16 kHz |
| Tasks in the paper | Speech recognition, language identification, translation and retrieval |
| Where to get it | huggingface.co/datasets/google/fleurs |

## How to read a FLEURS result

- Check the language set. An average over 102 languages, over 25 European languages and over 5 languages are different numbers. Phonon-2.5's FLEURS average of 11.71 % is over its 25 languages.
- Check the split and size. Results should be on the full test split of each language; a sample is noisier.
- Check the normaliser. Whether diacritics, punctuation and numbers are folded changes the score, especially outside English. Our FLEURS numbers keep diacritics.
- Expect a wide spread by language. On the same scoring, Phonon-2.5 ranges from 4.80 % in Spanish to 20.83 % in Greek.

## What FLEURS does not measure

FLEURS sentences are read aloud from written text, mostly in quiet conditions. Meetings, phone calls, accents, crosstalk and spontaneous speech with hesitations are all harder, and a model's FLEURS rank does not always carry over. For English, the Open ASR Leaderboard's sets (meetings, earnings calls, podcasts and more) cover more conditions. For your own use, test a sample of your own audio.

For a size reference on the same 25 FLEURS sets and the same scoring: Whisper base, which is about the size of Phonon-2.5, averages 53.71 %; Phonon-2.5 averages 11.71 %.

## Questions

## Related

- [FLEURS results in 25 languages](https://www.fermionresearch.com/speech/fleurs-results-25-languages/)
- [Text normalisation for ASR](https://www.fermionresearch.com/glossary/text-normalisation-for-asr/)
- [Phonon-2.5](https://www.fermionresearch.com/models/phonon-2-5/)
- [Multilingual speech recognition for European languages](https://www.fermionresearch.com/speech/multilingual-speech-recognition-european-languages/)
- [Introducing Phonon-2.5](https://www.fermionresearch.com/research/phonon-2-5/)

## Sources and method

- Conneau et al., FLEURS: Few-shot Learning Evaluation of Universal Representations of Speech, arXiv 2205.12446 (2022-05-25), read 2026-11-13.
- FLEURS dataset card: huggingface.co/datasets/google/fleurs, read 2026-11-13.
- Phonon numbers: Phonon-2.5 release post (/research/phonon-2-5/), 2026-10-22; Fermion Research measurement, full test sets, one scoring code for every model in a table.
- Whisper base on the same 25 FLEURS sets: Phonon-2.5 release post, 2026-10-22.

Canonical: https://www.fermionresearch.com/glossary/fleurs-benchmark/

Source: [https://www.fermionresearch.com/glossary/fleurs-benchmark/](https://www.fermionresearch.com/glossary/fleurs-benchmark/)
