Training a system to recognize scroll bars in an application under test

A system for training a test system to recognize scroll bars, comprising:

• a processor to execute an application under test;
• an interface to receive machine-generated inputs from the test system and provide application under test graphical user interface (GUI) outputs to the test system;
• and
• wherein the processor executes the application under test and receives inputs from the test system and provides outputs to the test system via the interface;
• and
• wherein the processor:
• captures a first image of the GUI at a first time;
• after the first time, provides the GUI with a mouse input comprising a machine-generated mouse middle-button input;
• captures a second image of the GUI at a second time after the mouse input;
• obtains a difference image comprising a difference between the first image and the second image;
• determines whether the difference image comprises an altered mouse pointer;
• and
• upon determining that the difference image does comprise the altered mouse pointer, provides the test system with a datum associated with the GUI of the application under test comprising a scroll bar.

A method for training a system to recognize scroll bars, comprising:

• executing an application under test and wherein the system provides machine-generated inputs to a graphical user interface (GUI) of the application under test and observes outputs from the application under test via the GUI;
• determining whether the GUI comprises a scroll bar candidate;
• upon determining that the GUI does comprise the scroll bar candidate, capturing a first image of the GUI at a first time;
• after the first time, providing the GUI with a mouse input comprising a machine-generated mouse middle-button input;
• capturing a second image of the GUI at a second time after the mouse input;
• obtaining a difference image comprising a difference between the first image and the second image;
• determining whether the difference image comprises an altered mouse pointer;
• and
• upon determining that the difference image does comprise the altered mouse pointer, causing a test to be added to a set of tests of the application under test in accordance with the GUI comprising a scroll bar.