US 11,698,849 B2 · Automated application testing of mutable interfaces

Abstract

Applications under test (AUT) may be tested by automated testing systems utilizing machine vision to recognize visual elements presented by the AUT and apply inputs to graphical elements, just as a human would. By utilizing the smallest image patch available, processing demands of the testing system are minimized. However, the image patch used to identify a portion of an AUT must be identifiable to the automated system. By selecting image patches that comprise the smallest size, but can be identified in an AUT by an automated system using machine vision, even as the AUT display is resized, reproportioned, noisy, or otherwise altered from the testing platform that was utilized for training.

Claims20

Dependent claims

An application testing system, comprising:

a data storage;
a processor comprising at least one microprocessor executing an application under test (AUT);
and
wherein the processor:
captures a first image of the AUT;
selects an image patch, wherein the image patch is a portion of the first image;
visually identifies a number of feature points within the image patch;
extends a boundary of the image patch, to an extended boundary, to add additional feature points to the number of feature points until the number of feature points satisfy a previously determined threshold number of feature points;
and
causes the image patch to be stored in a record maintained in the data storage.

7 more elements

Dependencies are inferred from the claim text.

Automated application testing of mutable interfaces

Life of this patent

Automated application testing of mutable interfaces

Life of this patent

Abstract

Claims20