Fact · Speech recognition
12.57percent word error rate
In our October 2026 test on a Mac with an M2 Pro, Parakeet TDT 0.6B v3 had a word error rate of 12.57 percent on 1224 conversational utterances by speakers of all 13 accent groups together (47 speakers) from the EdAcc corpus.
Measured by us on October 21, 2026, from 1224 recordings
Our own measurement
This number comes from our benchmark, not from another publication. The full record (the setup, every recording's checksum, every transcript and timing) is published, so you can recompute it.
- What it measures
- NVIDIA Parakeet TDT 0.6B v3 converted to Core ML (Parakeet Ultra, FluidInference, model revision 95eaa59a39d4), run through FluidAudio 0.17.4 on the CPU and GPU, with the language given. This is the engine the Yap app uses on Mac. The recordings are English conversations over video calls between people with different accents (EdAcc, University of Edinburgh, 2023), not read sentences, so error rates run higher than on our read-speech benchmark. The utterances were picked by a fixed rule before any engine ran: at least five words, 1.5 to 30 seconds, no overlapping speech, up to 100 per accent group spread across its speakers.
- How it is measured
- Word error rate = 3,464 word errors / 27,567 reference words = 12.57 percent, over 1224 utterances; hesitation fillers are left out of both texts and ok counts as okay, for every engine alike.
- What it does not show
- 47 speakers stand for all groups, so one speaker's voice, microphone and topic weigh heavily: compare engines within a group more than groups with each other. Numbers spoken as words in the reference count as errors when an engine writes digits.
In the data
A row of Speech Recognition and Accents: 13 English Accents Tested, as Parakeet TDT v3, All 13 groups: 12.57 percent.
- Engine
- Parakeet TDT v3
- Maker
- NVIDIA
- Accent group
- All 13 groups
- Kind of accent
- All
- Speakers
- 47
- Utterances
- 1224