Systems and methods for emulating the behavior of a user in a computer-human interaction environment

A computer system configured to emulate the behavior of a user in a computer-human interaction environment, comprising:

• a processor;
• memory in electronic communication with the processor
• instructions stored in the memory, the instructions being executable by the processor to:
• receive an image of a window and data relating to positions of clicks executed within the image;
• extract one or more features from the image related to human visual perception;
• combine the one or more extracted features with the data relating to the positions of the clicks executed within the image;
• create a probabilistic model from the combination to estimate a probability of a click being executed in a region of a window;
• execute clicks, in accordance with the probabilistic model, within windows associated with a plurality of applications;
• create a probability distribution model based on the position of the clicks executed within the windows of the plurality of applications;
• and
• execute clicks, in accordance with the probability distribution model, within a window associated with an application being tested.

A computer-program product for emulating the behavior of a user in a computer-human interaction environment, the computer-program product comprising a non-transitory computer-readable medium having instructions thereon, the instructions being executable by a processor to:

• receive an image of a window and data relating to positions of clicks executed within the image;
• extract one or more features from the image related to human visual perception;
• combine the one or more extracted features with the data relating to the positions of the clicks executed within the image;
• create a probabilistic model from the combination to estimate a probability of a click being executed in a region of a window;
• execute clicks, in accordance with the probabilistic model, within windows associated with a plurality of applications;
• create a probability distribution model based on the position of the clicks executed within the windows of the plurality of applications;
• and
• execute clicks, in accordance with the probability distribution model, within a window associated with an application being tested.