Fact · Languages and accents
94.8percent word error rate
On the Fleurs benchmark, the Whisper large-v2 model had a word error rate of 94.8 percent for Yoruba.
Checked against its source on October 16, 2026
In the source's own words
“Model Swedish Swahili Tamil Telugu Tajik Thai Turkish Ukrainian Urdu Uzbek Vietnamese Yoruba ... Whisper large-v2 8.5 39.3 17.5 99.0 85.8 11.5 8.4 8.6 22.6 90.2 10.3 94.8”
Robust Speech Recognition via Large-Scale Weak Supervision (full text), Alec Radford et al., OpenAI (arXiv), 2022, Table 13 (Fleurs).
Open the original (DOI 10.48550/arXiv.2212.04356)- What it measures
- Fleurs is a read-speech benchmark in about 100 languages. The figure is the error rate of the largest Whisper model in the table, run without fine-tuning, in the paper's own evaluation.
- What it does not show
- Read speech in good audio. Real dictation, accents and noise raise error rates. For languages written without spaces the paper reports character-level scoring, and the error rate can exceed 100 percent when the model writes extra text.
Source
Used to calculate
Cited on
- Dictation Languages, Accents and Voice TranslationTopic
- How Speech Recognition Works, From Sound to TextGuide
- Speech Recognition and Accents: Accuracy and FixesGuide
- How to Translate Audio and Video to English TextGuide
- Whisper Supported Languages and Accuracy by LanguageGuide
- Transcribe and Translate Audio in Other LanguagesGuide
- How do you translate a voice recording into English text?Question