Speaker awareness using speaker dependent speech model(s)

A client device comprising:

• one or more microphones;
• memory;
• one or more processors that execute instructions, stored in memory, to perform a method comprising:
• receiving an instance of audio data that captures one or more spoken utterances of a user of the client device, wherein the instance of audio data is captured using one or more microphones of the client device;
• determining a speaker embedding corresponding to a target user of the client device, the speaker embedding being generated based on audio data from the target user, wherein the target user is a primary user of the client device;
• processing the instance of audio data along with the speaker embedding using a speaker dependent (SD) voice activity detection (VAD) model to generate output indicating whether the audio data comprises voice activity that is of the target user of the client device, wherein the SD VAD model is personalizable to the target user of the client device;
• performing one or more actions based on the output, wherein performing the one or more actions based on the output comprises:
• determining, based on the output whether the audio data comprises voice activity that is of the target user;
• and
• in response to determining the audio data does not comprise voice activity that is of the target user, rendering output indicating the audio data does not comprise voice activity that is of the target user via one or more user interface output devices of the client device.

A non-transitory computer readable storage medium storing instructions executable by one or more processors of a computing system to perform a method comprising:

• receiving an instance of audio data that captures one or more spoken utterances of a user of a client device, wherein the instance of audio data is captured using one or more microphones of the client device;
• determining a speaker embedding corresponding to a target user of the client device, the speaker embedding being generated based on audio data from the target user, wherein the target user is a primary user of the client device;
• processing the instance of audio data along with the speaker embedding using a speaker dependent (SD) voice activity detection (VAD) model to generate output indicating whether the audio data comprises voice activity that is of the target user of the client device, wherein the SD VAD model is personalizable to the target user of the client device:
• performing one or more actions based on the output, wherein performing the one or more actions based on the output comprises:
• determining, based on the output whether the audio data comprises voice activity that is of the target user;
• and
• in response to determining the audio data does not comprise voice activity that is of the target user, rendering output indicating the audio data does not comprise voice activity that is of the target user via one or more user interface output devices of the client device.