Voice and AI
AI Voice Notes: From Rambling to Summaries and To-Dos
An AI voice note tool takes the transcript of your recording and condenses it, pulls out tasks or drafts a message. Phones and apps now do this on the device or in the cloud. Summaries can drop points you made and add ones you did not, so keep the transcript and check the summary against it before you act on it.
Updated October 17, 202611 min read33 cited facts, each traced to its source
18percent of reviewed notes with an accidental omission
In the UC Davis pilot, accidental omissions were the most frequent error, in 18 percent of the 356 reviewed notes, ahead of hallucinations at 11.5 percent and accidental inclusions at 9.3 percent.
Taylor SL et al., JMIR Medical Informatics, 2026
11.5percent of reviewed notes with a hallucination
In the UC Davis pilot, hallucinations, meaning content the recording did not support, appeared in 11.5 percent of the 356 reviewed notes, the second most common error after omissions.
Taylor SL et al., JMIR Medical Informatics, 2026
153words per minute
In a controlled study on an iPhone, English text entered by speech reached 153 words per minute, against 52 words per minute on the built-in keyboard, 2.93 times faster.
Sherry Ruan et al., Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), 2018
Speaking a voice note and letting AI structure it is the fastest way to capture a thought. The first step is a transcript, written by a speech recognizer. The second step is a language model that reads the transcript and condenses it, pulls out the tasks, or drafts a message from it. This guide covers that second step. Phones and note apps now do it themselves, some on the device and others in the cloud. The summaries are useful, but they are not a faithful copy of what you said. Published tests find that summaries can leave out points a speaker made and can add content the speaker never said, so keep the transcript and check the summary against it before you act on it. For getting the transcript itself, see our guide to voice memo transcription.
AI turns a rambling voice note into structured text only after the transcript exists
A voice note has two stages. The recognizer turns sound into words, and then a language model rewrites those words into a shorter, organized form. A model that reads a transcript never hears the audio. It sees only the text, so a mistake the recognizer made becomes an input the model cannot question. Our overview of AI voice typing explains how the recognizer and the model work together.
Speaking is faster than typing, so a voice note can hold a lot of content. In a controlled study on an iPhone, English text entered by speech reached 153 words per minute, against 52 words per minute on the built-in keyboard 1 2. At the speech rate of that study, 1,000 words take about 6.5 minutes to enter by speech 3, counting the time spent correcting errors. A long transcript gives the model more to condense.
The model makes the speed useful. A raw transcript of a voice note reads like speech: it repeats itself, backtracks and includes filler words such as "um" and "so". The model turns that into prose or a list. Whether it also cleans up the wording is a separate choice, covered in our guide to AI cleanup for dictation.
Summaries, task lists and drafts are three different jobs for the model
A summary, a task list and a draft are three different tasks, and each one fails in a different way. Ask for the job by name, and say what the model must keep. A prompt that asks for "the notes" invites the model to decide what matters for you.
| Job | What you ask for | What the model must keep | Typical failure |
|---|---|---|---|
| Summary | Five to ten main points in order | The speaker's main claims and any decision | Points dropped because they were said once |
| Task list | Every commitment, with owner and date | Who said they would do what, and by when | A task invented, or the wrong person assigned |
| Draft | An email, a message or a memo from the notes | The facts, numbers and names | Tone changed, or meaning changed |
The draft job carries the most risk, because the model writes new sentences. A 2026 preprint reports that large language models not only alter the voice and tone of human writing but also consistently alter its intended meaning 4. The same study finds that even when a model is given expert feedback and asked only for grammar edits, it still changes the text in a way that significantly alters its meaning 5. Treat a draft as a first version that you check line by line.
Summaries and task lists rewrite less text than a draft does, but they still depend on what the model chooses to keep. Google's Gemini API documentation lists describing, summarizing and answering questions about audio as uses, alongside transcription 6. The API accepts up to 9.5 hours of audio in a single prompt 7. That figure is for developers, and the Gemini app sets its own limits, so check them before you upload a long recording. The summary is only as good as the model's reading of the transcript.
For a worked to-do example, see how to turn voice notes into a to-do list. The short version is that a task list is a draft of commitments, not a record of them.
Phones and note apps now summarize recordings on their own
You no longer need a chatbot to summarize a recording. Some phones run the summary on the device, and others send the transcript to a cloud model. The features depend on the model, the software version and the language, and they change often, so check the current help page for your phone before you rely on one.
| Product | Transcript | Summary or suggestions | Requirements and limits |
|---|---|---|---|
| Samsung Voice Recorder with Transcript assist | Tap Transcribe after you select a recording | Tap Summarize from the Transcript assist icon; suggested reminders and events | 16 languages on the US page 8; select models only 9 |
| Google Pixel Recorder | Live transcription, and Transcribe again 10 for other languages | Summarize on the Pixel 8 Pro, in 2023 11 | The 2023 report describes summaries on the Pixel 8 Pro 11 |
| Apple Voice Memos on Mac | Transcribes speech in recordings 12 | Not covered in this guide | Apple silicon Mac, per Apple's macOS Sequoia guide 13 |
Samsung's Voice Recorder is the most complete example in the table. To make a transcript, you select the recording, tap the Transcript assist icon, and tap Transcribe 14. Samsung's US page lists 16 languages for Transcript assist 8. After the transcript is ready, a quick summary takes two taps: tap the Transcript assist icon, then tap Summarize 15. Samsung also suggests actions from the recording, such as reminders for tasks 16. These suggestions are a starting point. You still have to accept them, and the page's example is travel planning.
Google's Pixel Recorder followed a similar path. In December 2023, 9to5Google reported that the Gemini Nano-powered Summarize ran on the Pixel 8 Pro, while the newer "Transcribe again" option came to other Pixel devices 11. In August 2024, Google said Recorder summaries use Gemini Nano and keep processing on the device 17. The 2023 and 2024 reports are snapshots, so check which Pixel models and languages have summaries today.
Apple's Voice Memos app covers less ground. On a Mac, Voice Memos can recognize and transcribe speech in audio recordings 12. In Apple's guide for macOS Sequoia, that transcription is described for a Mac with Apple silicon 13. Once you have the transcript, copy it into a note or a document and give that text to a chatbot for the summary step.
Uploading a recording to a chatbot is another route. ChatGPT accepts audio files of up to 512 MB 18, but audio uploads are available only with paid subscriptions and workspaces 19. For the step-by-step answer, see can ChatGPT summarize a voice memo.
A word on what these tools are for. Yap, which we make, is an on-device dictation app for Mac and Windows. If the words are all you need, a dictation app without an AI rewrite may be enough, as our guide to speech to text without AI explains.
AI summaries leave things out and sometimes add them, so keep the transcript
A summary is a rewrite, and rewrites can go wrong in two directions. The model can drop a point, or it can add one. In 2020, researchers at Google asked people to review neural summaries of news articles. Their human annotators found substantial amounts of hallucinated content in every summary the models generated 20. Those were 2020 models, so today's rates may differ, but the paper established what a summary can add: content the source does not support.
Newer models still add content. Vectara runs a public leaderboard that asks each model to summarize a document, "using only the facts presented in the document," and then scores the result 21. The September 22, 2026 update lists the lowest hallucination rate at 1.8 percent 22 and the highest at 24.2 percent 23. The spread shows that the model you pick matters. It also shows that a low rate is not zero. Those figures come from one dataset of documents, not from your voice memo, so use them to compare models, not to judge a single summary.
Clinical notes give the closest measured picture of what goes wrong when AI turns a recorded conversation into a written record. In a 2024 pilot at UC Davis, physicians reviewed AI-generated clinical notes made from recorded visits. 94.7 percent of the 356 notes were free from significant errors 24. Errors of several kinds also appeared across the reviewed notes, and omission was the most common.
Omissions were the most frequent error, in 18 percent of reviewed notes 25. Hallucinations, meaning content the recording did not support, appeared in 11.5 percent 26. Accidental inclusions, meaning content from the visit that does not belong in the note, appeared in 9.3 percent 27. Physicians rated 5.3 percent of notes as containing an error that posed serious or imminent risk if it was not corrected 28. A separate study in npj Digital Medicine found the same pattern in LLM-generated notes: an omission rate of 3.45 percent 29 and a hallucination rate of 1.47 percent 30. Its authors worked for the company that sells the system they tested, so read these as results for one system, not for every scribe. These are clinical notes, not voice memos, but the same kinds of error can appear in a summary of your own recording.
The practical lesson is that the error you are most likely to miss is the missing point, not the invented one. A short, fluent summary hides a gap, so the omission is the one to hunt for. Check the summary against the transcript for three things: every decision and date in the transcript, every name and number, and every task. For the clinical version of this problem, see our guide to AI medical scribes, and the question on whether AI summaries of recordings are accurate gives a short answer.
Four steps turn a voice note into a checked summary
The workflow has four steps, and the review step is the one most people skip. Use it on every note that will drive a decision.
- Record the note. In Samsung's Voice Recorder, open the app and tap Record 31. Speak in full sentences, and state the names, dates and numbers once, clearly. Names and dates are the details you will most need later, so say them clearly.
- Make the transcript. Select the recording, tap the Transcript assist icon, and tap Transcribe 14. If you use another app, look for a transcript option, and see our guide to transcribing voice memos. Keep the transcript with the recording, because the review in step four needs both.
- Structure the transcript with a prompt. Ask for one job at a time. The prompts below are short, and the second one includes a rule against inventing details. The rule does not stop the model from making mistakes, so it still needs step four.
Summarize this transcript in five bullet points, in the order the speaker raised them. Use only what the speaker said. Write any name, date or number exactly as spoken, and mark anything unclear as [unclear].
List every commitment in this transcript as a task. For each task, give the owner, the due date if one was said, and the words the speaker used. If no owner or date was said, write "not stated". Do not add tasks that were not stated.
- Review against the transcript. Read the output with the transcript open. Check each task against the words it cites, and check each number and date against the recording. Delete anything you cannot find in the transcript.
Save the transcript and the summary together, in one note or document, so the review in the last step can see both. If the recording is private, read the guide to whether voice-to-text is safe before you upload it to a cloud model.
Long recordings need one more step. OpenAI says that processing of long audio uploads is best-effort, and that very long recordings may time out 32. Split a long recording into parts at natural breaks, and summarize each part before you combine them.
Common questions about AI voice notes
- Can ChatGPT summarize a voice memo? Upload the audio on a paid plan, if the file is within the upload limit, then ask for a summary. Check it against the transcript.
- How do you turn voice notes into a to-do list? Ask for every commitment with its owner and date, then delete any task you cannot find in the transcript.
- Are AI summaries of voice recordings accurate? Usually, but not always. Errors of omission are the most common, so check what is missing.
- Can your phone summarize a voice recording on its own? Some can. Samsung's Voice Recorder summarizes on select Galaxy phones 33, and Pixel Recorder summarizes with Gemini Nano on the phone 17. The feature depends on your model and language.
For more on the models behind these tools, see speech to text and large language models, and AI dictation cost if you want to compare cloud and on-device options. The overview of voice and AI links to every guide in this group.
Evidence
Every number on this page, with where it comes from. Open a fact to see the exact words in its source.
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
- 18.
- 19.
- 20.
- 21.
- 22.
- 23.
- 24.
- 25.
- 26.
- 27.
- 28.
- 29.
- 30.
- 31.
- 32.
- 33.
Questions about this
- Are AI summaries of voice recordings accurate?Usually, but not reliably. Published tests find that AI summaries can leave out points the speaker made and can add content the speaker never said. In the clinical notes we found, omitted points were the most common error, so compare the summary with the transcript before you act on it.
- Can ChatGPT summarize a voice memo?Yes, if you have a paid ChatGPT plan and the recording is within the 512 MB upload limit. ChatGPT can condense the audio into a summary, but a summary can leave out points you made, so check it against the transcript before you act on it.
- Can your phone summarize a voice recording on its own?Some can. Samsung's Voice Recorder summarizes a transcript on select Galaxy phones, Google says its Pixel Recorder makes summaries on the phone, on select Pixel models, and Apple can summarize a recording in Voice Memos on a Mac that supports Apple Intelligence. Check your device's current help page, because the models, languages and features change.
- How do you turn voice notes into a to-do list?Make a transcript, ask a model for every commitment with its owner and date, and check each task against the words it cites before you add it to your task app. An AI task list is a draft of what you said, not a record of it.
- How do you turn voice notes into text with AI?Turning a voice note into text is a speech recognition job: a model listens to the audio and writes out the words. Use the transcript option in your phone's recorder, a transcription app, or upload the file to a chatbot that accepts audio. Then check names, numbers and dates against the recording before you use the text.
More in Voice and AI
- Speech to Text AI: Dictation, Assistants and Voice AgentsThe overview of this topic
- AI Dictation: How AI Voice Typing Works
- Is Speech to Text AI? What Kind of AI Voice Typing Uses
- AI Cleanup for Dictation: Fillers, Punctuation, Rewrites
- Speech to Text for AI: Why Spoken Prompts Work Better
- Speech to Text and LLMs: What Language Models Change
- Speech to Text Without AI: Dictation With No AI Rewrite
- Voice Assistants vs Dictation: Siri, Alexa, Gemini
- Google Assistant Voice Commands and What Gemini Changes
- Home Assistant Voice: Speech to Text and Voice Commands
- AI Dictation Cost: Cloud vs On-Device Economics
- AI Voice Agents: How They Work and Where They Fail
- The Future of Typing: Voice, AI and the Keyboard
Referenced by
- Speech to Text AI: Dictation, Assistants and Voice AgentsTopic
- Are AI summaries of voice recordings accurate?Question
- Can ChatGPT summarize a voice memo?Question
- Can your phone summarize a voice recording on its own?Question
- How do you turn voice notes into a to-do list?Question
- How do you turn voice notes into text with AI?Question
- Prompt (AI)Glossary