Fact · Accessibility and health
0.82percentage points of word error rate
In our October 2026 test on Italian readings of a short passage by healthy speakers aged 60 to 77, Apple SpeechTranscriber's word error rate was 0.82 percentage points higher than Parakeet TDT 0.6B v3's (not a measured difference: its interval, allowing for the test's engine comparisons, includes zero, so the two engines count as level here).
Measured by us on October 23, 2026, from recordings
Our own measurement
This number comes from our benchmark, not from another publication. The full record (the setup, every recording's checksum, every transcript and timing) is published, so you can recompute it.
- What it measures
- Both engines transcribed the same recordings (Apple SpeechTranscriber: Apple's on-device speech model in macOS 26 (SpeechAnalyzer with a SpeechTranscriber module, transcription preset), with the locale given (en-US, de-DE, fr-FR, es-MX, it-IT, pt-BR). Parakeet TDT v3: NVIDIA Parakeet TDT 0.6B v3 converted to Core ML (Parakeet Ultra, FluidInference, model revision 95eaa59a39d4), run through FluidAudio 0.17.4 on the CPU and GPU, with the language given. This is the engine the Yap app uses on Mac.)
- How it is measured
- Difference of the two engines' pooled word error rates on the same recordings (+0.82 points). Interval: 5,000 paired bootstrap draws of persons (seed 7); 95% for this comparison alone +0.26 to +1.37, and allowing for all 15 engine comparisons (Bonferroni) -0.04 to +1.62 points, the interval the verdict stands on.
- What it does not show
- One language, read text and 15 to 28 speakers per group: an engine's lead here may not hold for other voices or for people dictating their own words.