Detection of potential exfiltration of audio data from digital assistant applications

A system comprising:

• a processor, a computer-readable memory, one or more computer-readable storage media, and program instructions collectively stored on the one or more computer-readable storage media, the program instructions executable to:
• receive a training dataset including sample input strings and sample output strings that are each labelled as a terminal statement, an anticipatory statement, or an expectative statement;
• apply each of the sample input strings and each of the sample output strings onto inputs of an I/O exchange model;
• obtain confidence metrics calculated using the I/O exchange model for each of the sample input strings and each of the sample output strings;
• adjust weights of the I/O exchange model based on a comparison of the confidence metrics and the labels for the sample input strings and the sample output strings;
• identify an input received from a digital assistant application via a microphone of a client device and an output received from an agent application that interfaces with the digital assistant application subsequent to the input;
• determine, using the I/O exchange model, that the output is terminal to the input based on a first set of strings included in the input and a second set of strings included in the output;
• and
• perform an action on at least one of the agent application and the digital assistant application based on the determining that the output is terminal to the input.

A method implemented by one or more processors, the method comprising:

• receiving a training dataset including sample input strings and sample output strings that are each labelled as a terminal statement, an anticipatory statement, or an expectative statement;
• applying each of the sample input strings and each of the sample output strings onto inputs of an I/O exchange model;
• obtaining confidence metrics calculated using the I/O exchange model for each of the sample input strings and each of the sample output strings;
• and
• adjusting weights of the I/O exchange model based on a comparison of the confidence metrics and the labels for the sample input strings and the sample output strings.