Application Programming Interfaces For On-Device Speech Services

A system comprising:

• data processing hardware;
• and
• memory hardware storing instructions that when executed on the data processing hardware causes the data processing hardware to perform operations comprising:
• receiving, from an application executing on the client device, at a speech service interface, configuration parameters for integrating a multilingual speech service into the application, the configuration parameters comprising a language pack directory that maps:
• a primary language code to an on-device path of a primary language pack of the multilingual speech service to load onto the client device for use in recognizing speech directed toward the application in a primary language specified by the primary language code;
• and
• each of one or more codeswitch language codes to an on-device path of a corresponding candidate language pack, each corresponding candidate language pack configured to recognize speech after a switch to a respective particular language specified by the corresponding codeswitch language code is detected by a language identification-(ID) predictor model;
• receiving audio data characterizing a first portion of an utterance directed toward the application;
• processing, using the language ID predictor model, the audio data to determine that the audio data is associated with the primary language code, thereby specifying that the first portion of the utterance includes speech spoken in the primary language;
• and
• based on the determination that the audio data is associated with the primary language code, processing, using the primary language pack loaded onto the client device, the audio data to determine a first transcription of the first portion of the utterance, the first transcription comprising one or more words in the primary language.