Determining functional and descriptive elements of application images for intelligent screen automation
AssigneeKofax, Inc.
InventorsVadim Alexeev, Benjamin De Coninck Owe
Life of this patent
Estimating the term…
Abstract
The presently disclosed inventive concepts are directed to systems, computer program products, and methods for intelligent screen automation. According to one embodiment, a method includes: determining one or more logical relationships between textual elements and non-textual elements of one or more images of a user interface; building a hierarchy comprising some or all of the non-textual elements and some or all of the textual elements in order to form a data structure representing functionality of the user interface; and outputting the data structure to a memory.
Claims20
A computer program product for determining functional and descriptive elements of application and interface images, the computer program product comprising a computer readable storage medium having embodied therewith computer readable program instructions configured to cause a processor, upon execution of the computer readable program instructions, to perform a method comprising:
- determining one or more logical relationships between textual elements and non-textual elements of one or more images of a user interface;
- building a hierarchy comprising some or all of the non-textual elements and some or all of the textual elements in order to form a data structure representing functionality of the user interface;
- and
- outputting the data structure to a memory.
A computer-implemented method, comprising:
- determining one or more logical relationships between textual elements and non-textual elements of one or more images of a user interface;
- building a hierarchy comprising some or all of the non-textual elements and some or all of the textual elements in order to form a data structure representing functionality of the user interface;
- and
- outputting the data structure to a memory.
Dependencies are inferred from the claim text.