Fact · Languages and accents
5.6percent word error rate
On the Fleurs benchmark, the Whisper large-v2 model had a word error rate of 5.6 percent for Russian.
Checked against its source on October 16, 2026
In the source's own words
“Model Dutch Occitan Punjabi Polish Pashto Portuguese Romanian Russian Sindhi Slovak Slovenian Shona Somali Serbian ... Whisper large-v2 6.7 75.3 102.4 5.4 93.7 4.3 14.4 5.6 156.5 11.7 23.1 121.0 102.9 33.9”
Robust Speech Recognition via Large-Scale Weak Supervision (full text), Alec Radford et al., OpenAI (arXiv), 2022, Table 13 (Fleurs).
Open the original (DOI 10.48550/arXiv.2212.04356)- What it measures
- Fleurs is a read-speech benchmark in about 100 languages. The figure is the error rate of the largest Whisper model in the table, run without fine-tuning, in the paper's own evaluation.
- What it does not show
- Read speech in good audio. Real dictation, accents and noise raise error rates. For languages written without spaces the paper reports character-level scoring, and the error rate can exceed 100 percent when the model writes extra text.