Question · Transcription
How do you transcribe audio with multiple speakers?
Use a transcription tool that returns speaker labels, check that it supports your language, and then name each speaker yourself. The tool numbers the voices, but it cannot know who they are, and its labels tend to go wrong where people talk over each other.
Updated October 17, 20263 min read8 cited facts, each traced to its source
Choose a tool that returns speaker labels, run the audio through it, and then do the two steps the software cannot do: name each speaker and check every change in the labels against the recording. The labels come from speaker diarization, which separates the voices and numbers them. Our guide to timestamps and speaker labels covers the mechanics in depth, and our overview of transcription covers the whole subject.
Step 1: Choose a tool that returns speaker labels
Not every speech-to-text product returns labels, so check before you upload. The table shows what each vendor's documentation says, as of the pages we read in October 2026.
| Product | Speaker labels | What the documentation says |
|---|---|---|
| Google Cloud Speech-to-Text | Yes | Labels each voice by number and tags each word with the speaker number 1 |
| ElevenLabs Scribe API | Yes | Returns structured JSON with speaker diarization and word-level timestamps 2 |
| OpenAI gpt-4o-transcribe-diarize | Yes, as a separate model | Use it "only when you need to identify who speaks during different parts of a recording" 3 |
| WhisperX (open source) | Yes | Provides "word-level timestamps and speaker diarization" 4 |
| Gemini live transcription | No | Speaker diarization is not supported in live streaming sessions 5 |
Live sessions are the trap. A tool that transcribes as people talk may not offer labels at all. For a recording you have already made, use a non-streaming option. Google points to its non-streaming audio transcription endpoint for speaker labels in that case 5.
Step 2: Check support for your language
Support for labels can depend on the language. Google's documentation says that speaker diarization is not available for every language, and tells you to "Review the language support page to see if this feature is available for your language" 6. Check that page before you choose a product for a recording in another language. Our guide to transcribing audio in other languages covers accuracy across languages.
Step 3: Understand the price model
Some vendors bill diarization on its own. AssemblyAI's pricing page lists speaker diarization at $0.02 per hour of audio 7. Multiply the hours of audio you have by the rate the vendor currently lists, and read the pricing page the day you buy, because prices change. Our guide to transcription software explains how to compare tools on price and features.
Step 4: Name each speaker once
The labels are numbers, so the names are your job. Replace each number with the person's name once, using the first place that voice speaks to confirm who it is. Do not assume that the order of speakers matches anything in the recording. The software has no way to know that the first voice is the host.
Step 5: Check every change in the labels
Labels tend to go wrong where the speaker changes, where two voices overlap and where turns are short. Play the audio at each change and confirm the voice. Short replies such as "yes" or "right" are the lines to check first, because they may leave a diarizer very little audio to work with. Mark any overlap you cannot separate, instead of guessing who spoke.
The reason to check is that diarization error is measured, not rare. In the second DIHARD challenge, the DKU-LENOVO team reported a diarization error rate of 27.90 percent on Track 2 8. That is a challenge benchmark, so a clean recording may do better, but the size of the error is the reason a check is worth your time.
Three mistakes make speaker labels less trustworthy
- Trusting the numbers as names. "Speaker 2" is a label, not a person. Verify it.
- Skipping the timestamps. Labels without timestamps are hard to check, because you cannot find the moment a voice changed. Turn on both.
- Comparing scores across papers. Diarization scores depend on the scoring rules, so compare numbers only when the rules match.
For more on the timestamp side of the job, see our question on how often to add timestamps to a transcript. For free tools that give timestamps without labels, see how to transcribe audio with timestamps for free. If your question is specifically about Whisper, see whether Whisper can identify different speakers.
Evidence
Every number on this page, with where it comes from. Open a fact to see the exact words in its source.
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
Go deeper
Related questions
- How do you transcribe audio with timestamps for free?
- How often should you add timestamps to a transcript?
- Are AI transcription devices and voice recorders worth it?
- Are automatic captions good enough for accessibility rules?
- Are transcription courses and certification worth it?
- Can AI transcribe Zulu, Xhosa and other African languages?
- Can Apple Notes transcribe audio recordings?
- Can ChatGPT transcribe audio files?
Referenced by
- Transcription: How to Turn Audio and Video Into TextTopic
- Timestamps and Speaker Labels in TranscriptsGuide
- How do you transcribe a lecture recording?Question
- How do you transcribe a QuickTime audio or screen recording?Question
- How do you transcribe audio with timestamps for free?Question
- How often should you add timestamps to a transcript?Question
- Which speech-to-text APIs can identify speakers?Question