Encrypting and/or decrypting audio data utilizing speaker features

A method implemented by one or more processors of a client device, the method comprising:

• processing a stream of audio data, detected via one or more microphones of the client device, to monitor for a spoken invocation phrase;
• processing at least a portion of the audio data to generate utterance features;
• receiving one or more speaker features provided by a target of a request included in audio data;
• determining whether the received speaker features match the utterance features;
• in response to determining that the speaker features match the utterance features:
• outputting the audio data to the target of the request;
• and
• in response to determining that the speaker features do not match the utterance features:
• suppressing outputting of the audio data to the target of the request.

A method implemented by one or more processors of a client device, the method comprising:

• receiving encrypted audio data of a user speaking an utterance, wherein the encrypted audio data is encrypted using one or more utterance features of the user;
• decrypting the audio data, utilizing one or more vectors generated from prior occurrences of the user speaking one or more utterances, to generate decrypted audio data;
• processing the decrypted audio data;
• and
• causing performance of one or more computer actions based on the processing of the decrypted audio data.