Question · Speech recognition
Which languages does speech recognition handle best?
In our test of 25 European languages, the best on-device engine reached a word error rate of 2.52 percent in Italian and 2.53 percent in Spanish. Maltese was hardest at 22.02 percent even with the better engine.
Updated October 19, 20264 min read24 cited facts, each traced to its source
Among the 25 European languages we tested, Italian, Spanish and Portuguese are handled best, and Maltese, Slovenian and the Baltic languages worst. Taking the better of Parakeet TDT v3 and Whisper large-v3-turbo for each language, Italian reached a word error rate of 2.52 percent 1 and Spanish 2.53 percent 2. Maltese was the hardest, at 22.02 percent 3. That is roughly one wrong word in forty for the best case and more than one in five for the worst.
The ranking says what current engines do on read speech in each language, not what is possible. Every language here is European, so it does not cover Asian, Arabic or African languages. Each language had the same 100 recordings from the FLEURS test set, on one Mac. The full benchmark dataset lists all 56 data points 4.
Italian, Spanish and Portuguese lead at under four percent
Best result per language, either engine, word error rate in percent (lower is better):
| Language | Better engine | Word error rate |
|---|---|---|
| Italian | Parakeet TDT v3 | 2.52 1 |
| Spanish | Whisper large-v3-turbo | 2.53 2 |
| Portuguese | Whisper large-v3-turbo | 3.28 5 |
| English | Whisper large-v3-turbo | 3.92 6 |
| Russian | Whisper large-v3-turbo | 4.59 7 |
| German | Parakeet TDT v3 | 4.84 8 |
Western European languages with large amounts of public speech data cluster at the top. English is in the top four, at 3.92 percent 6, rather than first. In every language above, a dictation draft needs only light correction. French (5.29 percent 9) and Dutch (6.32 percent 10) are in the next group down.
| Engine | Word error rate (WER %) | Source |
|---|---|---|
| Parakeet TDT v3 | 2.52 | Calculated 1 |
| Whisper large-v3-turbo | 2.73 | Calculated 11 |
| Apple SpeechTranscriber | 4.15 | Calculated 12 |
Maltese, Slovenian and the Baltic languages are hardest
Same measure, the six highest error rates among the better engines:
| Language | Better engine | Word error rate |
|---|---|---|
| Maltese | Parakeet TDT v3 | 22.02 3 |
| Slovenian | Parakeet TDT v3 | 19.83 13 |
| Lithuanian | Parakeet TDT v3 | 17.75 14 |
| Latvian | Parakeet TDT v3 | 17.27 15 |
| Danish | Whisper large-v3-turbo | 14.57 16 |
| Estonian | Parakeet TDT v3 | 14.17 17 |
Maltese is the extreme case. Whisper's error rate on it was 72.35 percent 18, so Parakeet is the only usable choice there, and even it misses more than one word in five.
| Engine | Word error rate (WER %) | Source |
|---|---|---|
| Parakeet TDT v3 | 22.02 | Calculated 3 |
| Whisper large-v3-turbo | 72.35 | Calculated 18 |
Greek shows that the engine can matter more than the language. Parakeet had 31.66 percent 19 in Greek, while Whisper had 11.96 percent 20. A language that looks hard for one engine can be fine for another. See Whisper or Parakeet.
The two engines differ most in the smaller languages
Across all the languages each engine supports, the median error rate is 10.11 percent for Parakeet 21 and 11.34 percent for Whisper 22. The medians sit well above the best languages, so a typical language in this set is harder than Italian or Spanish.
Apple's SpeechTranscriber covers only six of the 25 languages, so we compare it separately in the Apple against Whisper question. Apple's on-device Dictation list covers 22 languages 23, and built-in dictation features have a median of 15 languages across the products we tracked 24. Language support is a separate question from accuracy: an app can list a language and still do it poorly.
What this means if you dictate in your language
- Top group (Italian, Spanish, Portuguese, English, Russian, German): expect a clean draft. The choice of engine matters little.
- Middle group (Dutch, French, Ukrainian, Polish, Czech, Slovak, Romanian): good results, with more corrections for names and rare words.
- Hard group (Baltic languages, Slovenian, Maltese, Danish, Estonian): useful for notes, but plan to proofread everything, and pick the engine for your language rather than the overall winner.
What the data does not show
- Read speech in a quiet room. FLEURS sentences are read aloud. Real dictation has names, jargon and noise.
- A small sample per language. Each score comes from 100 recordings by a limited set of speakers, so close ranks (a few tenths of a point) are ties.
- European languages only, three engines. Languages like Mandarin, Hindi or Arabic are not in this dataset. See is speech recognition worse in other languages.
- Word error rate counts words. Languages that form long compound words, or that write without spaces, are not comparable on this measure.
Related reading
Start with our overview of speech recognition and the guide to on-device speech recognition. For single languages see German and Spanish; for support lists see what languages Whisper supports. Speeds by engine are in the speed dataset.
Evidence
Every number on this page, with where it comes from. Open a fact to see the exact words in its source.
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
- 18.
- 19.
- 20.
- 21.
- 22.
- 23.The 48 entries in Apple's On-Device and Modeless Dictation list belong to 22 different languages.
Calculated from 1 other fact
- 24.
The data behind these numbers
Go deeper
Related questions
- Can an ESP32 or microcontroller do speech recognition?
- Can you disable or uninstall Speech Recognition and Synthesis from Google?
- Can you run speech recognition on a Raspberry Pi?
- Is Apple's new on-device speech model as accurate as Whisper?
- Is on-device speech recognition as accurate as cloud?
- What is Speech Recognition and Synthesis from Google?
- Which on-device speech recognition is fastest on a Mac?
- Whisper or Parakeet: which is more accurate?