Fact · Dictation for work and study
1.47percent hallucination rate
In the npj Digital Medicine framework study, LLM-generated clinical notes had a hallucination rate of 1.47 percent, measured against clinician-annotated sentences.
Checked against its source on October 16, 2026
In the source's own words
“We observed a 1.47% hallucination rate and a 3.45% omission rate.”
A framework to assess clinical safety and hallucination rates of LLMs for medical text summarisation, Asgari E et al., npj Digital Medicine, 2025, Abstract.
Open the original (DOI 10.1038/s41746-025-01670-7)- What it measures
- The rate comes from 18 experimental configurations of LLM note generation, evaluated sentence by sentence by clinicians against the source conversation.
- What it does not show
- The authors were employees of Tortus AI, which sells the system tested, and the rates were reached after the authors refined prompts and workflows. It is not a measure of each commercial scribe in routine use.
Source
Cited on
- AI Dictation: How AI Voice Typing WorksGuide
- AI Medical Scribes and Ambient Clinical DocumentationGuide
- Human vs AI Transcription: Accuracy, Cost, SpeedGuide
- Transcribe Audio With Whisper, ChatGPT or GeminiGuide
- AI Voice Notes: From Rambling to Summaries and To-DosGuide
- Can ChatGPT transcribe audio files?Question
- How accurate are AI medical scribes?Question
- How do you turn a meeting transcript into minutes?Question
- Medical scribeGlossary