Skip to content

Our measurement ยท Accessibility and health

Dictation Accuracy With Parkinson's Speech, Tested

How much less accurately do speech recognition engines transcribe people with Parkinson's disease than healthy speakers of a similar age?

On a read passage, Whisper large-v3-turbo made 21.84 percent word errors on people with Parkinson's disease against 6.84 percent on healthy speakers aged 60 to 77, and Parakeet TDT v3 made 14.32 percent against 8.00 percent. Both gaps are measured, but Apple SpeechTranscriber's gap and every gap on short phrases cannot be told apart from chance, and the three engines are level within the Parkinson's group.

15 results, measured by usUpdated October 23, 2026Free to reuse under CC BY 4.0

21.84percent word error rate

In our October 2026 test on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 21.84 percent on 52 Italian readings of a short passage by 24 people with Parkinson's disease aged 40 to 80.

How it is calculated

6.84percent word error rate

In our October 2026 test on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 6.84 percent on 42 Italian readings of a short passage by 21 healthy speakers aged 60 to 77.

How it is calculated

14.32percent word error rate

In our October 2026 test on a Mac with an M2 Pro, Parakeet TDT 0.6B v3 had a word error rate of 14.32 percent on 52 Italian readings of a short passage by 24 people with Parkinson's disease aged 40 to 80.

How it is calculated

8.00percent word error rate

In our October 2026 test on a Mac with an M2 Pro, Parakeet TDT 0.6B v3 had a word error rate of 8.00 percent on 42 Italian readings of a short passage by 21 healthy speakers aged 60 to 77.

How it is calculated

Speech recognition makes more mistakes on people with Parkinson's disease than on healthy speakers of a similar age, but only on a longer read passage, and only for two of the three engines we tested. Whisper large-v3-turbo made 21.84 percent word errors on people with Parkinson's 1 against 6.84 percent on healthy speakers aged 60 to 77 2. Parakeet TDT v3 made 14.32 percent against 8.00 percent 3 4. For Apple SpeechTranscriber the difference is not distinguishable from chance, and neither is any difference on short sentences.

Our data has 15 data points 5. All come from the Italian Parkinson's Voice and Speech set (University of Bari and ASL Bari): 28 recording sessions of people with Parkinson's aged 40 to 80 (about 24 people), 21 healthy speakers aged 60 to 77 and 15 healthy speakers aged 19 to 29. We ran three engines on a Mac with an M2 Pro in October 2026. Lower numbers are better.

Two of three engines make measurably more errors on a read passage

The passage was read twice by every speaker. Here are the six figures for the two groups that matter for the question.

EngineMakerSpeakers in groupRecordingsWord error rate (%)Source
Apple SpeechTranscriberApple245210.55 to 17.83Calculated 6
Parakeet TDT v3NVIDIA245210.08 to 19.81Calculated 3
Whisper large-v3-turboOpenAI245213.47 to 33.02Calculated 1
EngineMakerSpeakers in groupRecordingsWord error rate (%)Source
Whisper large-v3-turboOpenAI21424.97 to 9.22Calculated 2
Parakeet TDT v3NVIDIA21426.06 to 10.31Calculated 4
Apple SpeechTranscriberApple21426.87 to 11.17Calculated 7

For Whisper, the Parkinson's figure of 21.84 percent 1 sits well above the older healthy figure of 6.84 percent 2. The 95% interval for that difference, adjusted for the number of comparisons in the test, excludes zero, so it is a measured difference. It is also the widest gap of the three engines in points.

For Parakeet, the figures are 14.32 percent 3 and 8.00 percent 4. That interval also excludes zero, but only just, so treat the size of the gap as uncertain.

For Apple, the figures are 13.81 percent 6 and 8.82 percent 7. The Parkinson's figure is higher, but the interval for the difference includes zero. With this many speakers, we cannot say that Apple's gap is real, and we cannot say it is absent.

Short sentences show no measured gap for any engine

Ten short sentences were read by the older healthy speakers and the people with Parkinson's only. On these, every engine scored higher for Parkinson's, and in every case the interval for the difference includes zero.

EngineParkinson'sHealthy, 60 to 77
Parakeet TDT v37.62 percent 85.30 percent 9
Whisper large-v3-turbo7.47 percent 104.04 percent 11
Apple SpeechTranscriber8.27 percent 125.30 percent 13

The people with Parkinson's also scored lower error rates on the sentences than on the passage for all three engines (for Whisper, 7.47 percent against 21.84 percent). Two things differ between the tasks, so the data cannot say which one matters: the passage is longer, and the sentence rows cover 22 speakers with 26 recordings while the passage rows cover 24 speakers with 52. The sentence figures are therefore not a clean test of the passage figures.

Age explains part of the gap, so compare with healthy speakers of the same age

Older healthy speakers are harder for every engine than young ones. On the passage, young speakers scored 1.79 percent with Parakeet 14, 3.04 percent with Whisper 15 and 3.89 percent with Apple 16. The older healthy speakers scored 8.00, 6.84 and 8.82 percent for the same three engines. All three age gaps are measured differences.

For Parakeet, the age gap is about as large in points as its Parkinson's gap against older healthy speakers. Comparing people with Parkinson's with young adults would therefore have overstated the effect of the disease, which is why the research question uses speakers of a similar age.

The engines are level for people with Parkinson's, even where the figures look far apart

In the Parkinson's group the passage figures run from 13.81 percent for Apple 6 and 14.32 percent for Parakeet 3 to 21.84 percent for Whisper 1. That looks like a real ranking, but the comparison of the engines on the same recordings does not support one 17. Whisper's errors sit in a few recordings, so its average is pulled up by a handful of them. On short sentences the three Parkinson's figures (7.62, 7.47 and 8.27 percent) are level too.

Engine differences are measured only on the passage, and only for healthy speakers:

  • Young speakers: Parakeet made fewer errors than Apple and than Whisper (1.79 percent against 3.89 and 3.04 percent).
  • Older healthy speakers: Whisper made fewer errors than Apple (6.84 percent against 8.82 percent). Parakeet, at 8.00 percent, is level with both.

The order therefore changes between groups, and none of these orderings is measured for people with Parkinson's.

Averages hide a few recordings that go badly wrong

The averages are driven by a minority of recordings. In every Parkinson's row, the typical speaker scored below the group average, while the worst single recording was far above it. The same pattern appears, less strongly, among the older healthy speakers. A group average therefore says little about whether the next speaker will be transcribed well. Severity of the disease, microphone distance and speaking rate probably matter, but this data does not record them, so we cannot say which.

What this data cannot tell you

  • One language and one region. Every recording is Italian, from one region of Italy. Other languages may behave differently. For how accent and language change accuracy, see our data on accent robustness.
  • Read text only. Speakers read a fixed passage and fixed sentences. Dictating your own words, with pauses and corrections, is a different task, and the set's unscripted speech is not part of this analysis.
  • Disease stage. Speakers with more advanced Parkinson's may fare differently from the people recorded here.
  • Small groups. With 15 to 24 speakers per group, the intervals are wide. A difference that includes zero is not a proof of no difference.
  • Three engines on one Mac. We tested on-device engines only. For speed and accuracy of on-device engines in general, see the on-device benchmark. Cloud engines are not covered.
  • Repeat sessions. Some people were recorded twice, so the sessions are not fully independent.

What this means if you have Parkinson's and want to dictate

Expect more errors than a healthy speaker of your age gets, and expect them to be uneven: most of a passage may come out well, while a few stretches come out badly. None of the three engines was measurably better for people with Parkinson's, so there is no engine to pick from this data alone. Choose on the other things that matter to you, such as whether audio stays on your device, and test with your own voice.

A few practical steps follow from the data:

  1. Try each candidate engine on a paragraph of your own reading, since averages hide individual variation.
  2. Dictate in short sentences if long passages go wrong for you. The short-sentence figures were lower for all three engines, though the data cannot prove the length is the cause.
  3. Plan to proofread. The worst recordings in the set were far from usable.
  4. If errors stay high, voice-trained or adaptive tools exist for speech impairments. Our guide to speech recognition for speech impairments covers them, and our overview of accessibility covers the wider set of options, including typing alternatives.

Evidence

Every number on this page, with where it comes from. Open a fact to see the exact words in its source.

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.

Every data point

Each row is one published figure for one group, in percent. The row opens its fact page with the exact words of the source; the source opens the original.

Source
Parakeet TDT v3, Young healthy speakers, read passageParakeet TDT v3NVIDIAYoung healthy speakersRead passage1530Italian1.17 to 2.45Our measurement
Whisper large-v3-turbo, Young healthy speakers, read passageWhisper large-v3-turboOpenAIYoung healthy speakersRead passage1530Italian2.35 to 3.71Our measurement
Apple SpeechTranscriber, Young healthy speakers, read passageApple SpeechTranscriberAppleYoung healthy speakersRead passage1530Italian3.07 to 4.8Our measurement
Whisper large-v3-turbo, Healthy speakers aged 60 to 77, read phrasesWhisper large-v3-turboOpenAIHealthy speakers aged 60 to 77Read phrases2121Italian2.52 to 5.75Our measurement
Apple SpeechTranscriber, Healthy speakers aged 60 to 77, read phrasesApple SpeechTranscriberAppleHealthy speakers aged 60 to 77Read phrases2121Italian3.86 to 6.92Our measurement
Parakeet TDT v3, Healthy speakers aged 60 to 77, read phrasesParakeet TDT v3NVIDIAHealthy speakers aged 60 to 77Read phrases2121Italian3.41 to 7.37Our measurement
Whisper large-v3-turbo, Healthy speakers aged 60 to 77, read passageWhisper large-v3-turboOpenAIHealthy speakers aged 60 to 77Read passage2142Italian4.97 to 9.22Our measurement
Parakeet TDT v3, Healthy speakers aged 60 to 77, read passageParakeet TDT v3NVIDIAHealthy speakers aged 60 to 77Read passage2142Italian6.06 to 10.31Our measurement
Apple SpeechTranscriber, Healthy speakers aged 60 to 77, read passageApple SpeechTranscriberAppleHealthy speakers aged 60 to 77Read passage2142Italian6.87 to 11.17Our measurement
Whisper large-v3-turbo, People with Parkinson's disease, read phrasesWhisper large-v3-turboOpenAIPeople with Parkinson's diseaseRead phrases2226Italian4.8 to 10.6Our measurement
Parakeet TDT v3, People with Parkinson's disease, read phrasesParakeet TDT v3NVIDIAPeople with Parkinson's diseaseRead phrases2226Italian4.76 to 10.62Our measurement
Apple SpeechTranscriber, People with Parkinson's disease, read phrasesApple SpeechTranscriberApplePeople with Parkinson's diseaseRead phrases2226Italian5.37 to 11.57Our measurement
Apple SpeechTranscriber, People with Parkinson's disease, read passageApple SpeechTranscriberApplePeople with Parkinson's diseaseRead passage2452Italian10.55 to 17.83Our measurement
Parakeet TDT v3, People with Parkinson's disease, read passageParakeet TDT v3NVIDIAPeople with Parkinson's diseaseRead passage2452Italian10.08 to 19.81Our measurement
Whisper large-v3-turbo, People with Parkinson's disease, read passageWhisper large-v3-turboOpenAIPeople with Parkinson's diseaseRead passage2452Italian13.47 to 33.02Our measurement

15 rows. Open a row for the exact words of its source.

Calculated from the rows

Every statistic is calculated by code from the rows above. Open one to see the exact values it summarises.

How this dataset is built

What counts as a row
Every recording of read text in the Italian Parkinson's Voice and Speech set (University of Bari and ASL Bari, 2016 and 2017): two readings of a short passage by each speaker, and a reading of ten short sentences by the older healthy speakers and the people with Parkinson's. Three groups: 28 recording sessions of people with Parkinson's disease aged 40 to 80 (about 24 people, as some were recorded twice), 21 healthy speakers aged 60 to 77 and 15 healthy speakers aged 19 to 29.
What does not
The set's isolated word list, syllables and held vowels (not dictation), people's own unscripted speech, other languages, other speech conditions such as dysarthria after a stroke, ALS or cerebral palsy, and cloud engines, for now.
How rows are found and checked
Each engine transcribed every recording on a Mac with the language set to Italian. Word error rate is computed against the text the speakers were given to read, as the dataset's authors published it, with the same normalization as our main benchmark (accents count). Speakers, not recordings, are the unit of the margins of error: intervals come from resampling persons with all their recordings, and a difference between two groups counts as measured only when its interval, allowing for the test's nine comparisons, excludes zero. Every file's checksum, reference and transcript are in the full record.
What the data cannot tell you
Speakers read a printed text, so the reference is what they were asked to read and a skipped or changed word counts as an engine error for every engine alike; reading slips may be more common in one group. The groups are small (15 to 28 speakers) and come from one region of Italy, most people with Parkinson's were at an early or middle stage of the disease (all but three below stage 4 of the modified Hoehn and Yahr scale), and Italian speech may not behave like English. Treat the numbers as how these engines handled these recordings, not as a clinical measure.

The whole method, from search to calculation, is on the research data page.

Cite and reuse

You may copy, share and adapt this dataset for any purpose, including commercially, if you credit it with a link. Quoted passages remain their authors' words: cite the original source for those.

Yap (2026). Speech recognition accuracy on the speech of people with Parkinson's disease [Data set]. https://yapapp.cc/data/asr-parkinsons-speech

License: CC BY 4.0.

Pages built on this data

More datasets

Read the overview: Speech to Text for Accessibility, RSI and Disabilities