Skip to content

Fact · Speech recognition

2.34percent word error rate

In our October 2026 test on a Mac with an M2 Pro, Apple SpeechTranscriber had a word error rate of 2.34 percent on 84 English readings of 3 to 4 minutes by 40 speakers, handed over as one recording of 3 to 4 minutes.

Measured by us on October 25, 2026, from recordings

Our own measurement

This number comes from our benchmark, not from another publication. The full record (the setup, every recording's checksum, every transcript and timing) is published, so you can recompute it.

What it measures
Apple's on-device speech model in macOS 26 (SpeechAnalyzer with a SpeechTranscriber module, transcription preset), with the locale given (en-US, de-DE, fr-FR, es-MX, it-IT, pt-BR). 84 examples of 3 to 4 minutes read by 40 speakers from public-domain audiobooks (LibriSpeech-Long test-clean, Google DeepMind, from LibriSpeech), clean recordings of read English. In the pieces condition the same audio was cut at pauses into pieces of 10 to 20 seconds, as someone dictating in short bursts would, and the pieces' text was joined.
How it is measured
Word error rate = 1,245 word errors / 53,292 reference words = 2.34 percent, over 5.45 hours of audio. 95% interval over speakers: 2.01 to 2.67 percent. Left-out words: 0.35 percent of the reference; examples that lost a passage of 10 or more words in a row: 0 of 84.
What it does not show
The same audio in pieces gave 2.33 percent; the difference (one recording minus pieces) is +0.01 points, with a 95% interval allowing for the test's 3 such comparisons of -0.12 to +0.14 points, which includes zero, so this test cannot tell it apart from chance. Audiobook reading in a quiet room is easier than dictating your own words at a desk, and an app may cut or stream audio in its own way; the test isolates what the length of one recording costs each engine.

In the data

A row of Dictation Accuracy on Long Recordings, Tested, as Apple SpeechTranscriber, in one recording: 2.01 to 2.67 percent.

Engine
Apple SpeechTranscriber
Maker
Apple
How the speech was handed over
One recording of about 4 minutes
Readings
84
Speakers
40
Language
English

Used to calculate