Skip to content

Fact · Accessibility and health

6.21percentage points of word error rate

In our October 2026 test, Parakeet TDT 0.6B v3's word error rate on Italian readings of a short passage was 6.21 percentage points higher for healthy speakers aged 60 to 77 than for healthy speakers aged 19 to 29 (a measured difference: its interval, allowing for the test's comparisons, excludes zero).

Measured by us on October 23, 2026, from recordings

Our own measurement

This number comes from our benchmark, not from another publication. The full record (the setup, every recording's checksum, every transcript and timing) is published, so you can recompute it.

What it measures
NVIDIA Parakeet TDT 0.6B v3 converted to Core ML (Parakeet Ultra, FluidInference, model revision 95eaa59a39d4), run through FluidAudio 0.17.4 on the CPU and GPU, with the language given. This is the engine the Yap app uses on Mac. Both groups read the same printed Italian text in the same room setup (Italian Parkinson's Voice and Speech, University of Bari and ASL Bari).
How it is measured
Difference of the two groups' pooled word error rates (+6.21 points; 4.47 times the rate). Interval: 5,000 bootstrap draws of persons in each group separately (seed 7); 95% for this comparison alone +4.15 to +8.57, and allowing for all 9 comparisons (Bonferroni) +3.40 to +9.63 points, the interval the verdict stands on.
What it does not show
Groups of 15 to 28 speakers from one region of Italy reading a fixed text. A difference also includes reading slips (a skipped or changed word counts as an error), which may be more common in one group.

Cited on