Automated combobox.select in a non-technology way

A system comprising:

• a processor;
• and
• a memory coupled with and readable by the processor and storing therein a set of instructions which, when executed by the processor, causes the processor to:
• execute one or more test scripts on an Application Under Test (AUT), the AUT including a graphical user interface (GUI) including a plurality of graphical elements and the one or more test scripts causing the processor to perform one or more functional tests on the AUT through the plurality of graphical elements of the GUI;
• capture a first image of the GUI at a first time;
• after the first time, provide the GUI with an input event to change a configuration of at least one of the plurality of graphical elements to include an expanded region;
• capture a second image of the GUI at a second time after the input event;
• generate a difference image by computing a difference between the first image and the second image based on an image of the GUI with an expandable graphical component in a collapsed state and an image of the GUI with the expandable graphical component in an expanded state;
• filter the difference image to detect an expandable graphical region of the expandable graphical component from text provided on the difference image;
• detect text blocks in the second image by applying optical character recognition (OCR) to candidate regions of the second image and label detected regions as background text blocks or candidate expanded region text blocks;
• determine whether the difference image includes one or more background text blocks and an expanded region text block;
• and
• select a labeled text block closest to a position of the at least one of the plurality of graphical elements as the expanded region text block.

A non-transitory, computer-readable medium comprising a set of instructions stored therein which when executed by a processor, causes the processor to:

• execute one or more test scripts on an Application Under Test (AUT), the AUT including a graphical user interface (GUI) including a plurality of graphical elements and the one or more test scripts causing the processor to perform one or more functional tests on the AUT through the plurality of graphical elements of the GUI;
• capture a first image of the GUI at a first time;
• after the first time, provide the GUI with an input event to change a configuration of at least one of the plurality of graphical elements to include an expanded region;
• capture a second image of the GUI at a second time after the input event;
• generate a difference image by computing a difference between the first image and the second image based on an image of the GUI with an expandable graphical component in a collapsed state and an image of the GUI with the expandable graphical component in an expanded state;
• filter the difference image to detect an expandable graphical region of the expandable graphical component from text provided on the difference image;
• detect text blocks in the second image by applying optical character recognition (OCR) to candidate regions of the second image and label detected regions as background text blocks or candidate expanded region text blocks;
• determine whether the difference image includes one or more background text blocks and the candidate expanded region text block;
• and
• select a labeled text block closest to a position of the at least one of the plurality of graphical elements as the candidate expanded region text block.