Fact · Speech recognition
10.68percent formatted error rate
In our October 2026 benchmark, counting punctuation and capital letters as a reader sees them, Apple SpeechTranscriber's text differed from the written Italian sentences by 10.68 errors per 100 tokens, against 4.15 for the words alone.
Measured by us on October 19, 2026, from 100 recordings
Our own measurement
This number comes from our benchmark, not from another publication. The full record (the setup, every recording's checksum, every transcript and timing) is published, so you can recompute it.
- What it measures
- Apple's on-device speech model in macOS 26 (SpeechAnalyzer with a SpeechTranscriber module, transcription preset), with the locale given (en-US, de-DE, fr-FR, es-MX, it-IT, pt-BR). The reference is FLEURS's written sentence, with its punctuation and capitals. The gap to the plain word error rate is the editing a dictated text needs for punctuation and capitals alone.
- How it is measured
- Formatted error rate = 282 errors / 2,640 reference tokens = 10.68 percent, over 100 recordings; tokens are words with their capitals plus each sentence mark (. , ! ? ; :) on its own.
- What it does not show
- FLEURS's sentences follow their source's punctuation, and a comma can be optional, so part of the gap is style rather than error, for every engine alike. Numbers written as digits against words count as errors.
In the data
A row of Dictation Punctuation and Capitalization Accuracy, as Apple SpeechTranscriber, Italian: 10.68 percent.
- Engine
- Apple SpeechTranscriber
- Maker
- Apple
- Language
- Italian
- Words only (WER)
- 4.15
Used to calculate
- In the formatted accuracy of on-device speech recognition: punctuation and capitals counted dataset, the 6 published figures for “Apple SpeechTranscriber” have a median of 10.62 percent, ranging from 10.34 to 100.
- The formatted accuracy of on-device speech recognition: punctuation and capitals counted dataset holds 56 data points, each a published figure traced to its source.