Artificial intelligence determined emotional state with dynamic modification of output of an interaction application

A non-transitory computer-readable medium storing a computer program for performing a method, the computer-readable medium comprising:

• program instructions for receiving an input from a user for an interaction application during execution of the interaction application;
• program instructions for receiving a first plurality of cues from a plurality of trackers, wherein each tracker of the plurality of trackers is configured to generate a respective cue using artificial intelligence (AI);
• program instructions for providing the plurality of cues to an AI model that is configured to receive input including one or more cues and to generate output including a classification of at least one emotion based on the one or more cues;
• program instructions for obtaining, from the AI model, a predicted emotion of the user;
• program instructions for generating initial content for the interaction application in response to the input from the user, wherein the initial content comprises a user interface having a first complexity level;
• program instructions for determining, based on the predicted emotion of the user, a modification to be made to the initial content, the modification including an overlay;
• program instructions for generating the overlay;
• and
• program instructions for applying the overlay to the initial content generate modified content for the interaction application, wherein applying the overlay to the initial content changes the first complexity level of the user interface such that the modified content comprises a modified user interface having a second complexity level that is different from the first complexity level.

A computer system comprising:

• a processor;
• memory coupled to the processor and having stored therein instructions that, if executed by the computer system, cause the computer system to execute a method, comprising:
• receiving an input from a user for an interaction application during execution of the interaction application;
• receiving a plurality of cues from a plurality of trackers, wherein each tracker of the plurality of trackers is configured to generate a respective cue using artificial intelligence (AI);
• providing the plurality of cues to an AI model that is configured to receive input including one or more cues and to generate output including a classification of at least one emotion based on the one or more cues;
• obtaining, as output from the AI model, a predicted emotion of the user;
• generating initial content for the interaction application in response to the input from the user, wherein the initial content comprises a user interface having a first complexity level;
• determining, based on the predicted emotion of the user, a modification to be made to the initial content, the modification including an overlay;
• generating the overlay;
• and
• applying the overlay to the initial content to generate modified content for the interaction application, wherein applying the overlay to the initial content changes the first complexity level of the user interface such that the modified content comprises a modified user interface having a second complexity level that is different from the first complexity level.