Chaos testing for voice enabled devices

A computer program product for testing a voice assistant device, the computer program product comprising:

• one or more computer readable storage media and program instructions collectively stored on the one or more computer readable storage media, the stored program instructions comprising:
• program instructions to receive test data from a database, the test data comprising a first set of coding parameters and a first user utterance having an expected device response, wherein the first set of coding parameters comprises one or more trigger words and one or more associated device responses;
• program instructions to generate a first modified user utterance by applying the first set of coding parameters to the first user utterance, wherein the first modified user utterance is acoustically different than the first user utterance;
• program instructions to audibly present the first modified user utterance to the voice assistant device;
• program instructions to receive a first voice assistant response from the voice assistant device;
• program instructions to determine that the first voice assistant response is substantially similar to the expected device response;
• responsive to determining the first voice assistant response is not substantially similar to the expected device response, program instructions to identify a first edge case based at least on the first set of coding parameters and the first modified user utterance;
• and
• program instructions to determine a second set of coding parameters based on at least one of the first set of coding parameters, the first modified user utterance, and the first edge case.

A computer system for testing a voice assistant device, the computer system comprising:

• one or more computer processors;
• one or more computer readable storage media;
• program instructions collectively stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, the stored program instructions comprising:
• program instructions to receive test data from a database, the test data comprising a first set of coding parameters and a first user utterance having an expected device response, wherein the first set of coding parameters comprises one or more trigger words and one or more associated device responses;
• program instructions to generate a first modified user utterance by applying the first set of coding parameters to the first user utterance, wherein the first modified user utterance is acoustically different than the first user utterance;
• program instructions to audibly present the first modified user utterance to the voice assistant device;
• program instructions to receive a first voice assistant response from the voice assistant device;
• program instructions to determine that the first voice assistant response is substantially similar to the expected device response;
• responsive to determining the first voice assistant response is not substantially similar to the expected device response, program instructions to identify a first edge case based at least on the first set of coding parameters and the first modified user utterance;
• and
• program instructions to determine a second set of coding parameters based on at least one of the first set of coding parameters, the first modified user utterance, and the first edge case.