Adaptive interface in a voice-based networked system

A system to generate voice-based interfaces in a networked system, comprising at least one server device comprising a memory and one or more processors to:

• receive, by an automated assistant executed by the one or more processors, audio data corresponding to a spoken utterance of a user, the audio data comprising the spoken utterance detected at a client device that includes an automated assistant interface for interacting with the automated assistant;
• process, by a speech recognition engine executed by the one or more processors, the audio data using a first speech recognition model corresponding to a first language to identify a first request;
• select, a content selector component executed by the one or more processors and based on processing the audio data using the first speech recognition model, a first digital component that is responsive to the first request;
• transmit, by the content selector component, the first digital component to the client device to render the first digital component to the user, wherein the first digital component includes a prompt that solicits further input from the user;
• receive, by the speech recognition engine, second audio data comprising an additional spoken utterance generated in response to the prompt, the second audio data detected at the client device;
• determine, by the speech recognition engine, to use a second speech recognition model for a second language in response to receiving the second audio data;
• process, by the speech recognition engine, the second audio data using the second speech recognition model for the second language to determine a second request;
• select, by the content selector component and based on processing the second audio data using the second speech recognition model for the second language, a second digital component based on the second request;
• and
• transmit, by the content selector component, the second digital component to the client device to render in response to the second audio data.

A method to generate voice-based interfaces in a networked system, comprising:

• receiving audio data corresponding to a spoken utterance of a user, the audio data comprises the spoken utterance detected at a client device that includes an automated assistant interface for interacting with an automated assistant;
• processing the audio data using a first speech recognition model corresponding to a first language to identify a first request;
• selecting, based on processing the audio data using the first speech recognition model, a first digital component that is responsive to the first request;
• transmitting the first digital component to the client device to render the first digital component to the user, wherein the first digital component includes a prompt that solicits further input from the user;
• receiving second audio data comprising an additional spoken utterance generated in response to the prompt, the second audio data detected at the client device;
• determining to use a second speech recognition model for a second language in response to receiving the second audio data;
• processing the second audio data using the second speech recognition model for the second language to determine a second request;
• selecting, based on processing the second audio data using the second speech recognition model for the second language, a second digital component based on the second request;
• and
• transmitting the second digital component to the client device to render in response to the second audio data.