Fact · Languages and accents
13.6percent word error rate
On the Hindi subset of the Vistaar benchmark, IndicWhisper, which fine-tunes Whisper on Indian-language data, had an average word error rate of 13.6 percent across seven test sets.
Checked against its source on October 17, 2026
In the source's own words
“IndicWhisper 10.3 12.0 11.4 15.0 7.6 12.0 26.8 13.6”
Vistaar: Diverse Benchmarks and Training Sets for Indian Language ASR, Kaushal Santosh Bhogale et al., Interspeech 2023 (arXiv:2305.15386), 2023, Table 3.
Open the original- What it measures
- The Vistaar authors fine-tuned Whisper for 12 Indian languages on 10.7K hours of public training data, and compared it with public and commercial recognizers. The row here is the Hindi subset, with the average in the last column.
- What it does not show
- The table compares fine-tuned Whisper with other public and commercial systems. It does not give the untuned Whisper result on the same seven Hindi sets, so it does not measure the gain from fine-tuning alone.