Vendor page
An All-Neural On-Device Speech Recognizer
Johan Schalkwyk, Google Research Blog, 2019
Read the originalRead on October 16, 2026
- What it is
- Google's March 12, 2019 announcement of an end-to-end speech recognizer small enough to run on a phone, used for voice typing in Gboard. It explains why earlier recognizers needed a server and gives the size of the old server graph and the new on-device model.
- How much weight it carries
- First-hand account by the Google speech team of its own product, backed by a peer-reviewed paper. The launch details (Pixel phones, American English) describe 2019 and have since expanded.
Facts taken from this source
- In 2019 Google said its new on-device Gboard speech recognizer was initially launched to all Pixel phones in American English only.
“Our new all-neural, on-device Gboard speech recognizer is initially being launched to all Pixel phones in American English only.” (Final paragraphs on compression and launch)
- In 2019 Google moved Gboard voice typing onto the phone with an 80 MB speech recognizer that works even when the phone is offline, first on Pixel phones in American English.
“the new recognizer is always available, even when you are offline ... After compression, the final model is 80MB. Our new all-neural, on-device Gboard speech recognizer is initially being launched to all Pixel phones in American English only.” (Introduction and Offline Recognition section)
- Google said its 2019 on-device Gboard speech recognizer uses a model trained with RNN transducer technology that is compact enough to reside on a phone.
“we present a model trained using RNN transducer (RNN-T) technology that is compact enough to reside on a phone” (Introduction of the post)
- Google announced in 2019 an end-to-end, all-neural, on-device speech recognizer to power speech input in Gboard.
“Today, we're happy to announce the rollout of an end-to-end, all-neural, on-device speech recognizer to power speech input in Gboard.” (Opening section of the post)
- Google said in 2019 that its new on-device recognizer design offered the same accuracy as its traditional server-based models in a much smaller model.
“The RNN-T we trained offers the same accuracy as the traditional server-based models but is only 450MB” (Offline Recognition section)
- Google said in 2019 that its new on-device speech recognizer is always available, even when the phone is offline.
“the new recognizer is always available, even when you are offline.” (Post body)
- Google says its RNN-T recognizer continuously processes input audio and streams output symbols, a property that suits speech dictation, and in its implementation the symbols are characters.
“continuously processes input samples and streams output symbols, a property that is welcome for speech dictation. In our implementation, the output symbols are the characters of the alphabet.” (Body of the 2019 Google Research blog post)
- Google said its traditional server-side recognizer used a search graph of almost 2 GB, too large for a phone, which is why it needed a connection.
“the search graph remains quite large, almost 2GB for our production models. Since this is not something that could be hosted easily on a mobile phone, this method requires online connectivity to work properly.” (Offline Recognition section)
Pages that rest on this source
- Dictation Languages: What Each App and Device SupportsGuide
- Offline Voice Typing on iPhone and AndroidGuide
- Does Google voice typing use AI?Question
- What is the best offline speech to text app for Android?Question
- Dictation Software: How to Choose the Right AppTopic
- Dictation and Voice to Text on iPhone and AndroidTopic
- Speech Recognition: What It Is and How Well It WorksTopic
- Speech to Text Privacy: Where Your Voice GoesTopic
- Google Docs Voice Typing: How to Use It and Its LimitsGuide
- How Speech Recognition Works, From Sound to TextGuide
- Is Voice to Text Safe? How to Dictate PrivatelyGuide
- What Is Dictation Software? Types and How It WorksGuide
- What Is Dictation? Voice Typing and Talk to Text ExplainedGuide
- Is Speech to Text AI? What Kind of AI Voice Typing UsesGuide
- How to Dictate Into Any App: Built-in vs System-WideGuide
- Voice Typing on Android: How to Use Talk to TextGuide
- Talk to Text on Samsung Galaxy: How to Use ItGuide
- Voice Typing Not Working on Android: How to Fix ItGuide
- Best Dictation Apps for iPhone and AndroidGuide
- Speech Recognition Models: How Neural ASR WorksGuide
- Voice Typing in WhatsApp and Messaging AppsGuide
- Dictation Languages on iPhone and AndroidGuide
- On-Device vs Cloud Speech Recognition: The TradeoffsGuide
- History of Speech Recognition: From Audrey to WhisperGuide