Providing automated user input to an application

A method performed by a computing device, the method comprising:

• obtaining application output by an interactive application;
• providing the application output to a user interaction model, wherein the user interaction model:
• processes the application output to obtain application output embeddings;
• and
• maps the application output embeddings to automated user inputs;
• and
• providing the automated user inputs to the interactive application.

A system comprising:

• a hardware processing unit;
• and
• a storage resource storing computer-readable instructions which, when executed by the hardware processing unit, cause the hardware processing unit to:
• process application output by a particular application to obtain application output features representing the application output;
• process the application output features using a user interaction model to obtain automated user inputs;
• and
• provide the automated user inputs to the particular application.

A computer-readable storage medium storing computer-readable instructions which, when executed by a hardware processing unit, cause the hardware processing unit to perform acts comprising:

• receiving haptic output of an interactive application;
• inputting the haptic output to a user interaction model that processes the haptic output to predict automated user inputs;
• and
• in at least one instance, providing the predicted automated user inputs to application in place of actual user input.