Preprint
Open ASR Leaderboard: Towards Reproducible and Transparent Speech Recognition Evaluation
Hugging Face and collaborators, arXiv, 2025
Read the originalRead on October 16, 2026
- What it is
- A 2025 preprint describing the Open ASR Leaderboard, a benchmark that compares open-source and proprietary speech recognition systems on accuracy and speed.
- How much weight it carries
- A preprint with a public benchmark and open code; results are reproducible but the leaderboard changes as systems are added.
Facts taken from this source
- The Open ASR Leaderboard paper observes that Conformer-based encoders paired with transformer-based decoders achieve the best average word error rate.
“Conformer-based encoders paired with transformer-based decoders achieve the best average WER” (Abstract)
- The Open ASR Leaderboard compares 86 open-source and proprietary speech recognition systems across 12 datasets.
“It compares 86 open-source and proprietary systems across 12 datasets” (Abstract)
- The Open ASR Leaderboard paper says token-and-duration transducer (TDT) decoders offer superior speed (RTFx), which makes them better suited for long-form and batched processing.
“token-and-duration transducer (TDT) decoders offer superior RTFx, making them better suited for long-form and batched processing” (Abstract)
Pages that rest on this source
- Speech Recognition: What It Is and How Well It WorksTopic
- How Speech Recognition Works, From Sound to TextGuide
- Speech Recognition Models: How Neural ASR WorksGuide
- Speech Recognition Benchmarks and LeaderboardsGuide
- Which neural network is best for speech recognition?Question
- ConformerGlossary
- Offline Speech to Text on Windows: What WorksGuide
- What is the most accurate dictation software?Question
- What is the Open ASR Leaderboard?Question
- Speech-to-Text APIs Compared: Price, Accuracy, SpeedGuide
- Real-Time Speech Recognition: Streaming and LatencyGuide
- RNN transducer (RNN-T)Glossary