Fact · Speech recognition
Quantized whisper.cpp models require less memory and disk space, and can run more efficiently on some hardware.
Checked against its source on October 17, 2026
In the source's own words
“Quantized models require less memory and disk space and depending on the hardware can be processed more efficiently.”
whisper.cpp README, Georgi Gerganov, GitHub, 2026, Quantization.
Open the original- What it measures
- The README shows how to quantize a model with the Q5_0 method and run it with the whisper-cli example.
- What it does not show
- The README does not give an accuracy cost for quantization. Check your own audio if you use a quantized model.