Evaluation of voice-based artificial intelligence (ai) agents

An apparatus for evaluation of an artificial intelligence (AI) agent, comprising:

• one or more memories storing processor-executable code;
• and
• one or more processors coupled with the one or more memories and individually or collectively operable to execute the code to cause the apparatus to:
• map, to a plurality of voice-based interaction scenarios, a plurality of personas that each indicate a plurality of respective voice-based interaction characteristics that are based at least in part on a subset of stored training data that are representative of the plurality of respective voice-based interaction characteristics;
• train an AI testing model capable of performing voice-based interactions that are in accordance with a first voice-based interaction scenario of the plurality of voice-based interaction scenarios and that are based at least in part on the respective voice-based interaction characteristics indicated by a first persona of the plurality of personas;
• provoke, in accordance with a testing protocol, a first voice-based interaction between the AI testing model and the AI agent;
• evaluate the first voice-based interaction based at least in part on one or more voice interaction metrics;
• and
• generate a report indicating the one or more voice interaction metrics and one or more results of the evaluation.

A non-transitory computer-readable medium storing code for evaluation of an artificial intelligence (AI) agent, the code comprising instructions executable by one or more processors to:

• map, to a plurality of voice-based interaction scenarios, a plurality of personas that each indicate a plurality of respective voice-based interaction characteristics that are based at least in part on a subset of stored training data that are representative of the plurality of respective voice-based interaction characteristics;
• train an AI testing model capable of performing voice-based interactions that are in accordance with a first voice-based interaction scenario of the plurality of voice-based interaction scenarios and that are based at least in part on the respective voice-based interaction characteristics indicated by a first persona of the plurality of personas;
• provoke, in accordance with a testing protocol, a first voice-based interaction between the AI testing model and the AI agent;
• evaluate the first voice-based interaction based at least in part on one or more voice interaction metrics;
• and
• generate a report indicating the one or more voice interaction metrics and one or more results of the evaluation.