Computing system for macro generation, modification, verification, and execution

A method executed by a processor of a computing device when the processor executes an automation application, the method comprising:

• generating a macro for a target application that is executed on the computing device, wherein the macro is generated based upon:
• a sequence of inputs from a user received by the target application, wherein the sequence of inputs causes the target application to perform an action;
• screen states of the target application as the target application receives the sequence of inputs from the user;
• operating system processes that are performed by an operating system of the computing device as the target application receives the sequence of inputs from the user;
• and
• evidence events representing information obtained from the operating system processes;
• storing the macro in a data store that is accessible to the computing device;
• and
• subsequent to storing the macro in the data store, executing the macro, wherein executing the macro causes the automation application to mimic the sequence of inputs to the target application, thereby causing the target application to perform the action, and further wherein mimicking the sequence of inputs is conditioned upon observing the screen states, the operating system processes, and the evidence events as the macro is being executed.

A computing device comprising:

• a processor;
• and
• memory storing an automation application, wherein the automation application, when executed by the processor, causes the processor to perform acts comprising:
• accessing a macro for a target application, wherein the macro has been generated based upon a sequence of inputs from a user received by the target application, wherein the sequence of inputs causes the target application to perform an action, wherein the macro includes a directed graph comprising nodes and directed edges, the nodes comprising a first subset of nodes and a second subset of nodes, wherein the first subset of the nodes are assigned to the sequence of inputs, wherein the second subset of the nodes are assigned to potential inputs to the target application, wherein the directed edges connect the first subset of the nodes, wherein each directed edge in the directed edges is assigned criteria that are to be satisfied in order to traverse each directed edge;
• and
• executing the macro, wherein executing the macro causes the automation application to mimic the sequence of inputs to the target application by traversing the first subset of nodes in the directed graph via the directed edges connecting the first subset of the nodes.