Skip to content

Fact · Accessibility and health

5.30percent word error rate

In our October 2026 test on a Mac with an M2 Pro, Apple SpeechTranscriber had a word error rate of 5.30 percent on 21 Italian readings of ten short sentences by 21 healthy speakers aged 60 to 77.

Measured by us on October 23, 2026, from 21 recordings

Our own measurement

This number comes from our benchmark, not from another publication. The full record (the setup, every recording's checksum, every transcript and timing) is published, so you can recompute it.

What it measures
Apple's on-device speech model in macOS 26 (SpeechAnalyzer with a SpeechTranscriber module, transcription preset), with the locale given (en-US, de-DE, fr-FR, es-MX, it-IT, pt-BR). The speakers read a printed text aloud in a quiet room with a microphone 15 to 25 cm away (Italian Parkinson's Voice and Speech, University of Bari and ASL Bari, recorded 2016 and 2017). The reference is the text they were given, so a word a speaker skipped or changed counts as an error for every engine alike.
How it is measured
Word error rate = 59 word errors / 1,113 reference words = 5.30 percent, over 21 recordings (10.4 minutes of audio). The 95% interval over speakers is 3.86 to 6.92 percent.
What it does not show
21 speakers from one region of Italy, in one language, reading a fixed text: a person dictating their own words, in another language or with more advanced Parkinson's may fare differently. Half of these speakers had an error rate of 3.8 percent or less, the highest was 13.2 percent.

In the data

A row of Dictation Accuracy With Parkinson's Speech, Tested, as Apple SpeechTranscriber, Healthy speakers aged 60 to 77, read phrases: 3.86 to 6.92 percent.

Engine
Apple SpeechTranscriber
Maker
Apple
Speakers
Healthy speakers aged 60 to 77
What they read
Read phrases
Speakers in group
21
Recordings
21
Language
Italian

Used to calculate

Cited on