Fact · Speech recognition
5.08percent
In the on-device speech recognition word error rates on FLEURS dataset, the 11 published figures for “Whisper large-v3-turbo” have a median of 5.08 percent, ranging from 2.53 to 23.51.
Calculated from 11 data points on October 19, 2026
- What it measures
- Each figure is one row of the dataset: a published measurement for a stated group, traced to its source. The median is the middle value of the 11 figures for this group.
- How it is calculated
- Median of 11 values (2.53, 2.73, 3.28, 3.92, 4.59, 5.08, 6.62, 6.83, 11.34, 18.64, 23.51) = 5.08.
- What it does not show
- Read sentences from Wikipedia in quiet conditions are easier than dictation, conversation or noise. Numbers and spelling variants are not normalized, which counts '25' against 'twenty-five' as an error for every engine alike. One Mac, one run; we make Yap, which uses Parakeet, so we publish everything needed to check us.
A statistic of the dataset On-Device Speech Recognition Benchmark on a Mac, calculated by code from its published rows.
Calculated from
- In our October 2026 benchmark on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 5.08 percent on 100 German recordings from the FLEURS test set.
- In our October 2026 benchmark on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 3.92 percent on 100 English recordings from the FLEURS test set.
- In our October 2026 benchmark on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 2.53 percent on 100 Spanish recordings from the FLEURS test set.
- In our October 2026 benchmark on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 6.62 percent on 100 French recordings from the FLEURS test set.
- In our October 2026 benchmark on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 11.34 percent on 100 Croatian recordings from the FLEURS test set.
- In our October 2026 benchmark on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 2.73 percent on 100 Italian recordings from the FLEURS test set.
- In our October 2026 benchmark on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 18.64 percent on 100 Latvian recordings from the FLEURS test set.
- In our October 2026 benchmark on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 3.28 percent on 100 Portuguese recordings from the FLEURS test set.
- In our October 2026 benchmark on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 4.59 percent on 100 Russian recordings from the FLEURS test set.
- In our October 2026 benchmark on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 23.51 percent on 100 Slovenian recordings from the FLEURS test set.
- In our October 2026 benchmark on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 6.83 percent on 100 Ukrainian recordings from the FLEURS test set.