{"dataset":{"name":"Speech recognition accuracy on the speech of people with Parkinson's disease","title":"Dictation Accuracy With Parkinson's Speech, Tested","question":"How much less accurately do speech recognition engines transcribe people with Parkinson's disease than healthy speakers of a similar age?","url":"https://yapapp.cc/data/asr-parkinsons-speech","measure":{"label":"Word error rate","unit":"percent","short":"%","decimals":2,"lowerIsBetter":true},"dimensions":[{"key":"engine","label":"Engine","values":["Parakeet TDT v3","Whisper large-v3-turbo","Apple SpeechTranscriber"]},{"key":"maker","label":"Maker"},{"key":"group","label":"Speakers","values":["Young healthy speakers","Healthy speakers aged 60 to 77","People with Parkinson's disease"]},{"key":"task","label":"What they read","values":["Read passage","Read phrases"]},{"key":"speakers","label":"Speakers in group"},{"key":"recordings","label":"Recordings"},{"key":"language","label":"Language"}],"include":"Every recording of read text in the Italian Parkinson's Voice and Speech set (University of Bari and ASL Bari, 2016 and 2017): two readings of a short passage by each speaker, and a reading of ten short sentences by the older healthy speakers and the people with Parkinson's. Three groups: 28 recording sessions of people with Parkinson's disease aged 40 to 80 (about 24 people, as some were recorded twice), 21 healthy speakers aged 60 to 77 and 15 healthy speakers aged 19 to 29.","exclude":"The set's isolated word list, syllables and held vowels (not dictation), people's own unscripted speech, other languages, other speech conditions such as dysarthria after a stroke, ALS or cerebral palsy, and cloud engines, for now.","method":"Each engine transcribed every recording on a Mac with the language set to Italian. Word error rate is computed against the text the speakers were given to read, as the dataset's authors published it, with the same normalization as our main benchmark (accents count). Speakers, not recordings, are the unit of the margins of error: intervals come from resampling persons with all their recordings, and a difference between two groups counts as measured only when its interval, allowing for the test's nine comparisons, excludes zero. Every file's checksum, reference and transcript are in the full record.","limitations":"Speakers read a printed text, so the reference is what they were asked to read and a skipped or changed word counts as an engine error for every engine alike; reading slips may be more common in one group. The groups are small (15 to 28 speakers) and come from one region of Italy, most people with Parkinson's were at an early or middle stage of the disease (all but three below stage 4 of the modified Hoehn and Yahr scale), and Italian speech may not behave like English. Treat the numbers as how these engines handled these recordings, not as a clinical measure.","sources":0,"updated":"2026-10-23","license":"https://creativecommons.org/licenses/by/4.0/","credit":"Yap (2026). Speech recognition accuracy on the speech of people with Parkinson's disease [Data set]. https://yapapp.cc/data/asr-parkinsons-speech"},"rows":[{"row":"Parakeet TDT v3, Young healthy speakers, read passage","value":1.79,"low":1.17,"high":2.45,"as_written":"1.17 to 2.45","unit":"percent","engine":"Parakeet TDT v3","maker":"NVIDIA","group":"Young healthy speakers","task":"Read passage","speakers":15,"recordings":30,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Parakeet TDT 0.6B v3 had a word error rate of 1.79 percent on 30 Italian readings of a short passage by 15 healthy speakers aged 19 to 29.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-parakeet-young-passage-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Whisper large-v3-turbo, Young healthy speakers, read passage","value":3.04,"low":2.35,"high":3.71,"as_written":"2.35 to 3.71","unit":"percent","engine":"Whisper large-v3-turbo","maker":"OpenAI","group":"Young healthy speakers","task":"Read passage","speakers":15,"recordings":30,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 3.04 percent on 30 Italian readings of a short passage by 15 healthy speakers aged 19 to 29.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-whisper-young-passage-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Apple SpeechTranscriber, Young healthy speakers, read passage","value":3.89,"low":3.07,"high":4.8,"as_written":"3.07 to 4.8","unit":"percent","engine":"Apple SpeechTranscriber","maker":"Apple","group":"Young healthy speakers","task":"Read passage","speakers":15,"recordings":30,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Apple SpeechTranscriber had a word error rate of 3.89 percent on 30 Italian readings of a short passage by 15 healthy speakers aged 19 to 29.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-apple-young-passage-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Whisper large-v3-turbo, Healthy speakers aged 60 to 77, read phrases","value":4.04,"low":2.52,"high":5.75,"as_written":"2.52 to 5.75","unit":"percent","engine":"Whisper large-v3-turbo","maker":"OpenAI","group":"Healthy speakers aged 60 to 77","task":"Read phrases","speakers":21,"recordings":21,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 4.04 percent on 21 Italian readings of ten short sentences by 21 healthy speakers aged 60 to 77.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-whisper-elderly-phrases-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Apple SpeechTranscriber, Healthy speakers aged 60 to 77, read phrases","value":5.3,"low":3.86,"high":6.92,"as_written":"3.86 to 6.92","unit":"percent","engine":"Apple SpeechTranscriber","maker":"Apple","group":"Healthy speakers aged 60 to 77","task":"Read phrases","speakers":21,"recordings":21,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Apple SpeechTranscriber had a word error rate of 5.30 percent on 21 Italian readings of ten short sentences by 21 healthy speakers aged 60 to 77.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-apple-elderly-phrases-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Parakeet TDT v3, Healthy speakers aged 60 to 77, read phrases","value":5.3,"low":3.41,"high":7.37,"as_written":"3.41 to 7.37","unit":"percent","engine":"Parakeet TDT v3","maker":"NVIDIA","group":"Healthy speakers aged 60 to 77","task":"Read phrases","speakers":21,"recordings":21,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Parakeet TDT 0.6B v3 had a word error rate of 5.30 percent on 21 Italian readings of ten short sentences by 21 healthy speakers aged 60 to 77.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-parakeet-elderly-phrases-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Whisper large-v3-turbo, Healthy speakers aged 60 to 77, read passage","value":6.84,"low":4.97,"high":9.22,"as_written":"4.97 to 9.22","unit":"percent","engine":"Whisper large-v3-turbo","maker":"OpenAI","group":"Healthy speakers aged 60 to 77","task":"Read passage","speakers":21,"recordings":42,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 6.84 percent on 42 Italian readings of a short passage by 21 healthy speakers aged 60 to 77.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-whisper-elderly-passage-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Parakeet TDT v3, Healthy speakers aged 60 to 77, read passage","value":8,"low":6.06,"high":10.31,"as_written":"6.06 to 10.31","unit":"percent","engine":"Parakeet TDT v3","maker":"NVIDIA","group":"Healthy speakers aged 60 to 77","task":"Read passage","speakers":21,"recordings":42,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Parakeet TDT 0.6B v3 had a word error rate of 8.00 percent on 42 Italian readings of a short passage by 21 healthy speakers aged 60 to 77.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-parakeet-elderly-passage-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Apple SpeechTranscriber, Healthy speakers aged 60 to 77, read passage","value":8.82,"low":6.87,"high":11.17,"as_written":"6.87 to 11.17","unit":"percent","engine":"Apple SpeechTranscriber","maker":"Apple","group":"Healthy speakers aged 60 to 77","task":"Read passage","speakers":21,"recordings":42,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Apple SpeechTranscriber had a word error rate of 8.82 percent on 42 Italian readings of a short passage by 21 healthy speakers aged 60 to 77.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-apple-elderly-passage-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Whisper large-v3-turbo, People with Parkinson's disease, read phrases","value":7.47,"low":4.8,"high":10.6,"as_written":"4.8 to 10.6","unit":"percent","engine":"Whisper large-v3-turbo","maker":"OpenAI","group":"People with Parkinson's disease","task":"Read phrases","speakers":22,"recordings":26,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 7.47 percent on 26 Italian readings of ten short sentences by 22 people with Parkinson's disease aged 40 to 80.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-whisper-parkinson-phrases-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Parakeet TDT v3, People with Parkinson's disease, read phrases","value":7.62,"low":4.76,"high":10.62,"as_written":"4.76 to 10.62","unit":"percent","engine":"Parakeet TDT v3","maker":"NVIDIA","group":"People with Parkinson's disease","task":"Read phrases","speakers":22,"recordings":26,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Parakeet TDT 0.6B v3 had a word error rate of 7.62 percent on 26 Italian readings of ten short sentences by 22 people with Parkinson's disease aged 40 to 80.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-parakeet-parkinson-phrases-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Apple SpeechTranscriber, People with Parkinson's disease, read phrases","value":8.27,"low":5.37,"high":11.57,"as_written":"5.37 to 11.57","unit":"percent","engine":"Apple SpeechTranscriber","maker":"Apple","group":"People with Parkinson's disease","task":"Read phrases","speakers":22,"recordings":26,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Apple SpeechTranscriber had a word error rate of 8.27 percent on 26 Italian readings of ten short sentences by 22 people with Parkinson's disease aged 40 to 80.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-apple-parkinson-phrases-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Apple SpeechTranscriber, People with Parkinson's disease, read passage","value":13.81,"low":10.55,"high":17.83,"as_written":"10.55 to 17.83","unit":"percent","engine":"Apple SpeechTranscriber","maker":"Apple","group":"People with Parkinson's disease","task":"Read passage","speakers":24,"recordings":52,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Apple SpeechTranscriber had a word error rate of 13.81 percent on 52 Italian readings of a short passage by 24 people with Parkinson's disease aged 40 to 80.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-apple-parkinson-passage-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Parakeet TDT v3, People with Parkinson's disease, read passage","value":14.32,"low":10.08,"high":19.81,"as_written":"10.08 to 19.81","unit":"percent","engine":"Parakeet TDT v3","maker":"NVIDIA","group":"People with Parkinson's disease","task":"Read passage","speakers":24,"recordings":52,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Parakeet TDT 0.6B v3 had a word error rate of 14.32 percent on 52 Italian readings of a short passage by 24 people with Parkinson's disease aged 40 to 80.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-parakeet-parkinson-passage-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"},{"row":"Whisper large-v3-turbo, People with Parkinson's disease, read passage","value":21.84,"low":13.47,"high":33.02,"as_written":"13.47 to 33.02","unit":"percent","engine":"Whisper large-v3-turbo","maker":"OpenAI","group":"People with Parkinson's disease","task":"Read passage","speakers":24,"recordings":52,"language":"Italian","conversion":null,"claim":"In our October 2026 test on a Mac with an M2 Pro, Whisper large-v3-turbo had a word error rate of 21.84 percent on 52 Italian readings of a short passage by 24 people with Parkinson's disease aged 40 to 80.","quote":null,"where_in_source":null,"fact_url":"https://yapapp.cc/facts/m-parkinson-2026-10-whisper-parkinson-passage-wer","source_title":null,"source_publisher":null,"source_year":null,"source_url":null,"source_doi":null,"checked":"2026-10-23"}]}