Digital signal processor-based continued conversation

An assistant-enabled device (AED) comprising:

• data processing hardware;
• and
• memory hardware in communication with the data processing hardware and storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
• in response to receiving a response to an initial query submitted by a user of the assistant-enabled device to a digital assistant, instructing an always-on first processor of the data processing hardware to operate in a follow-on query detection mode and an active second processor of the data processing hardware to return to a sleep state;
• and
• while the always-on first processor operates in the follow-on query detection mode:
• receiving, at the always-on first processor, follow-on audio data captured by the assistant-enabled device in an environment of the assistant-enabled device, the follow-on audio data not containing a hotword;
• determining, using a voice activity detection (VAD) model executing on the always-on first processor, whether or not the VAD model detects voice activity in the follow-on audio data;
• performing, using a speaker identification (SID) model executing on the always-on first processor, speaker verification on the follow-on audio data to determine whether the follow-on audio data comprises an utterance spoken by the same user that submitted the initial query to the digital assistant;
• and
• when the VAD model detects voice activity in the follow-on audio data and the follow-on audio data comprises the utterance spoken by the same user that submitted the initial query, initiating a wake-up process on a second processor of the data processing hardware to determine whether the utterance comprises a follow-on query directed toward the digital assistant.