Automatically determining language for speech recognition of spoken utterance received via an automated assistant interface

A non-transitory computer readable storage medium configured to store instructions that, when executed by one or more processors, cause the one or more processors to perform operations that include:

• processing audio data using an acoustic model corresponding to a given language to monitor for an occurrence of an invocation phrase configured to invoke an automated assistant, wherein the audio data is based on detection of spoken input of a user at a client device that includes an automated assistant interface for interacting with the automated assistant;
• detecting, based on processing the audio data using the acoustic model, the occurrence of the invocation phrase in a portion of the audio data;
• determining, based on processing of the audio data using the acoustic model, that the portion of the audio data that includes the invocation phrase corresponds to a user profile that is accessible to the automated assistant;
• identifying a set of languages, including the given language, assigned to the user profile;
• selecting a speech recognition model for the given language;
• using the selected speech recognition model to process a subsequent portion of the audio data that follows the portion of the audio data;
• causing the automated assistant to provide responsive content that is determined based on the processing of the subsequent portion using the selected speech recognition model;
• subsequent to causing the automated assistant to provide the responsive content:
• processing additional audio data based on detection of additional spoken input of the user;
• using the selected speech recognition model to process the additional audio data to generate a first candidate text representation of the additional audio data in the given language;
• identifying an additional language, in the set of languages assigned to the user profile;
• selecting an additional speech recognition model, corresponding to the additional language;
• using the selected additional speech recognition model to process the additional audio data to generate a second candidate text representation of the additional audio data in the additional language;
• selecting the second candidate text representation in the additional language, in lieu of the first candidate text representation in the given language;
• and
• causing the automated assistant to provide additional responsive content that is determined based on processing the second candidate text representation.

A system comprising:

• one or more processors;
• and
• memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations that include:
• processing audio data using an acoustic model corresponding to a given language to monitor for an occurrence of an invocation phrase configured to invoke an automated assistant, wherein the audio data is based on detection of spoken input of a user at a client device that includes an automated assistant interface for interacting with the automated assistant;
• detecting, based on processing the audio data using the acoustic model, the occurrence of the invocation phrase in a portion of the audio data;
• determining, based on processing of the audio data using the acoustic model, that the portion of the audio data that includes the invocation phrase corresponds to a user profile that is accessible to the automated assistant;
• identifying a set of languages, including the given language, assigned to the user profile;
• selecting a speech recognition model for the given language;
• using the selected speech recognition model to process a subsequent portion of the audio data that follows the portion of the audio data;
• causing the automated assistant to provide responsive content that is determined based on the processing of the subsequent portion using the selected speech recognition model;
• subsequent to causing the automated assistant to provide the responsive content:
• processing additional audio data based on detection of additional spoken input of the user;
• using the selected speech recognition model to process the additional audio data to generate a first candidate text representation of the additional audio data in the given language;
• identifying an additional language, in the set of languages assigned to the user profile;
• selecting an additional speech recognition model, corresponding to the additional language;
• using the selected additional speech recognition model to process the additional audio data to generate a second candidate text representation of the additional audio data in the additional language;
• selecting the second candidate text representation in the additional language, in lieu of the first candidate text representation in the given language;
• and
• causing the automated assistant to provide additional responsive content that is determined based on processing the second candidate text representation.