Question · Speech recognition
Is speech recognition more accurate than humans?
Not in general. On one telephone benchmark in 2016, a Microsoft system matched professional transcribers, at 5.8 percent word error against their 5.9 percent. Humans remain far more accurate in noise and on speech the system has not learned, so the answer depends on the audio and on which human you compare with.
Updated October 17, 20263 min read9 cited facts, each traced to its source
Not in general. Machines have reached human level on a few specific tests, mostly clean or telephone speech. On noisy audio, and on speech the system has not learned, careful human listeners still make fewer errors. The honest comparison is always made on the same recording, against the same checked transcript.
One telephone benchmark put machines level with professional transcribers
In 2016, Microsoft researchers reported a system that scored a 5.8 percent word error rate on the Switchboard telephone test 1. Professional transcribers scored 5.9 percent on the same portion 2. The authors called this human parity. On CallHome, a harder test of conversations between friends and family, the system reached 11.0 percent against 11.3 percent for the humans.
A gap of a tenth of a point is a tie for practical purposes. The result is still narrow. It covers one benchmark, one kind of telephone speech and one set of professional transcribers, so it does not show that machines beat humans in general.
The Whisper paper, from 2022, reaches a similar and more cautious conclusion. Its English recognition is "not perfect but very close to human-level accuracy" 3. "Very close" is a weaker claim than "better".
On noisy audio, humans stay far ahead
Noise is where the comparison turns. In a 1997 review of noise experiments, a machine with noise adaptation reached 12.8 percent error at a signal-to-noise ratio of 10 dB, while human listeners made about 1 percent errors at the same level 4. Those are old systems, so the numbers show the size of the gap at the time, not today. The lesson still holds: a score on clean audio does not carry over to a café, a car or a windy street.
Human baselines also vary between studies. The table sets the 1997 and 2016 Switchboard results side by side.
| Study and test | Machine error | Human error |
|---|---|---|
| Lippmann, 1997, Switchboard telephone | 43 percent 5 | 4 percent 6 |
| Xiong et al., 2016, Switchboard telephone | 5.8 percent 1 | 5.9 percent 2 |
On the same telephone test, the two studies' human figures differ, 4 percent in 1997 and 5.9 percent in 2016. The two studies used different transcribers, instructions and reference transcripts. So a "human parity" claim is only as strong as the human baseline behind it.
Four cases where the answer changes
- Clean, read speech: this is the easiest case, and the gap is smallest on modern systems. Even so, a 1997 review found machine error often more than ten times human error on quiet, read speech 7, which shows how much the answer has moved since then.
- Live or streamed speech: a 2024 study of eleven services found significantly lower quality for streaming recognition, the mode used for live events 8.
- Invented words: a machine can add a fluent phrase that was never said. In a 2024 study, about 1 percent of Whisper transcriptions contained whole phrases or sentences that did not exist in the audio 9. A careful human transcriber does not usually do that.
- Names and jargon: a specialist who knows the field often beats a general model on rare terms. The question on names and jargon explains why.
Compare on the same recording
A fair test needs one recording, one reference transcript that someone has checked, and both a machine and a human working on the same audio. Count the errors for each against that reference, using the word error rate formula. A number from a vendor page, or from a study on other audio, tells you little about your own recordings. The human versus AI transcription guide compares cost, speed and accuracy for each option.
What to do
- Decide what the output is for. A rough draft you will edit can tolerate more errors than a final record.
- Run the passage test on your own voice and microphone. Read a 200-word passage, dictate it, and count the errors. The accuracy guide explains the steps.
- Keep a person in the loop when errors are costly. For legal, medical or financial text, a qualified person should check the transcript.
- Proofread the risky parts. Check names, numbers and the words just after a long pause. These are where a machine error is most likely to look confident.
For the bigger picture, see our overview of speech recognition, and the full guide to speech recognition accuracy. The companion questions cover whether speech recognition is less accurate for some people and why Whisper makes up words nobody said.
Evidence
Every number on this page, with where it comes from. Open a fact to see the exact words in its source.
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
Go deeper
Related questions
- Is speech recognition less accurate for some people?
- What is a speech recognition threshold in a hearing test?
- Why does speech recognition get names and jargon wrong?
- Why does Whisper make up words nobody said?
- Can an ESP32 or microcontroller do speech recognition?
- Can large language models do speech recognition?
- Can Whisper AI do text to speech?
- Can Whisper identify different speakers?
Referenced by
- Speech Recognition: What It Is and How Well It WorksTopic
- How Accurate Is Speech Recognition? The Real NumbersGuide
- Is on-device speech recognition as accurate as cloud?Question
- Is speech recognition less accurate for some people?Question
- What are the most important speech recognition research papers?Question
- Why does speech recognition get names and jargon wrong?Question
- Why does Whisper make up words nobody said?Question