Question · Speech recognition
How accurate is Deepgram?
Deepgram's Nova-3 scored a 5.2 percent word error rate on Artificial Analysis's three-dataset index, so about 5 words in 100 are wrong. That is accurate, but behind AssemblyAI's Universal-3.5 Pro at 3.0 percent and several other newer models.
Updated October 27, 20263 min read13 cited facts, each traced to its source
Deepgram is accurate, but not the most accurate speech-to-text API on public English tests. On the independent Artificial Analysis index, Nova-3 scored a 5.2 percent word error rate (WER) 1. WER is the share of words a system gets wrong, so lower is better and 5.2 percent means roughly 5 wrong words in every 100. On the same index AssemblyAI's Universal-3.5 Pro scored 3.0 percent 2.
Treat any single WER as a guide, not a promise. Your result depends on your audio, and the sources below disagree by several points.
On an independent index, Nova-3 trails the newest models
Artificial Analysis runs paid APIs on three test datasets with one method, which makes it the fairest like-for-like comparison we found. Its figures:
| Service | AA-WER, percent |
|---|---|
| ElevenLabs Scribe v2 | 2.2 3 |
| AssemblyAI Universal-3.5 Pro | 3.0 2 |
| OpenAI GPT Transcribe | 3.3 4 |
| Google Chirp 3 | 4.3 5 |
| Deepgram Nova-3 (served by Telnyx) | 4.8 6 |
| Deepgram Nova-3 | 5.2 1 |
The same Nova-3 model scored 4.8 through Telnyx and 5.2 through Deepgram's own API. Settings and test dates differ between listings, so a half-point gap should not decide anything. A gap of two points, as between Nova-3 and the leaders, is more meaningful.
Deepgram's own and rivals' benchmarks disagree
At launch, Deepgram reported a 5.26 percent median WER for Nova-3 on batch audio and 6.84 percent on streaming in its own tests 7. AssemblyAI's comparison page, on its own test, gives Nova-3 an average of 7.9 percent against 5.93 percent for its Universal-3.5 Pro 8. Neither vendor publishes its test audio, so neither can be checked, and each favors its own product. Our question on why accuracy claims differ explains how the choice of test set moves the numbers.
Older evidence is weaker, and live audio trades accuracy for speed
A 2024 academic study of university lecture recordings measured Deepgram at an average 8.3 percent WER on English, against 2.9 percent for Whisper large-v2 9. That study predates Nova-3, so it describes earlier models, not the current one.
On live audio, Deepgram's Flux model was the fastest service in Artificial Analysis's 2026 streaming benchmark, returning a final transcript 0.020 seconds after speech ended, at a WER of 7.36 percent 10. Its first partial transcript had a 7.4 percent WER, against 3.6 percent for ElevenLabs' realtime model 11. For a voice agent that must reply quickly, that tradeoff can be right. For captions people will read, it may not be.
Deepgram also does not appear in the English results of Hugging Face's Open ASR Leaderboard that we read on 20 October 2026, so there is no direct comparison there.
It depends: what changes your own error rate
- Audio quality. Noise, distance from the microphone and overlapping speakers raise WER for every system.
- Vocabulary. Names and jargon are the usual failures. Deepgram's Keyterm Prompting, its form of custom vocabulary, accepts up to 100 terms per request 12.
- Language. Public scores are mostly English. Test your language directly.
- Scoring rules. Whether punctuation, capitals and filler words count changes WER a lot. See what counts as a good word error rate.
What to do
- Do not choose on a leaderboard alone. Collect 30 to 60 minutes of your real audio and write correct reference transcripts.
- Run it through Nova-3, add your key terms and run it again, then score both with WER.
- Run the same files through AssemblyAI and one other service. The $200 credit covers the test 13.
- If live speed matters more than the last point of accuracy, weigh Flux separately.
Continue with Deepgram vs AssemblyAI, how much Deepgram costs, the guide to Deepgram and the overview of speech recognition. For the best-scoring options overall, see the question on the most accurate speech-to-text API.
Evidence
Every number on this page, with where it comes from. Open a fact to see the exact words in its source.
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
- 12.
- 13.
The data behind these numbers
Go deeper
Related questions
- Deepgram vs AssemblyAI: which speech-to-text API is better?
- How much does Deepgram cost?
- Are open-source speech recognition models as accurate as paid APIs?
- AssemblyAI vs OpenAI Whisper: which is more accurate?
- Can an ESP32 or microcontroller do speech recognition?
- Can large language models do speech recognition?
- Can Whisper AI do text to speech?
- Can Whisper identify different speakers?