Application-specific graphical element detection
AssigneeUiPath, Inc.
InventorsDaniel Dines, Ion Miron
Life of this patent
Estimating the term…
Abstract
Graphical element detection using a combined series and delayed parallel execution unified target technique that potentially uses a plurality of graphical element detection techniques, performs default user interface (UI) element detection technique configuration at the application and/or UI type level, or both, is disclosed. The unified target merges multiple techniques of identifying and automating UI elements into a single cohesive approach. A unified target descriptor chains together multiple types of UI descriptors in series, uses them in parallel, or uses at least one technique first for a period of time and then runs at least one other technique in parallel or alternatively if the first technique does not find a match within the time period.
Claims20
A computer-implemented method for detecting graphical elements in a user interface (UI), comprising:
- receiving, by a robotic process automation (RPA) designer application running on a computing system, a selection of an application or a UI type;
- receiving and saving a default targeting method settings configuration, by the RPA designer application;
- receiving an indication of a screen to be automated, by the RPA designer application, the screen pertaining to the selected application or UI type;
- and
- automatically preconfiguring the default targeting method settings for the selected application or UI type, by the RPA designer application, wherein
- the default targeting method settings configuration provides settings for one or more default targeting methods, the one or more default targeting methods comprising types of UI descriptors.
A non-transitory computer-readable medium storing a computer program, the computer program configured to cause at least one processor to:
- automatically preconfigure default targeting method settings for a selected application or user interface (UI) type;
- receive modifications to the default targeting method settings for the application or the UI type;
- configure the default targeting method settings in accordance with the modifications;
- and
- configure one or more activities in a robotic process automation (RPA) workflow using the default targeting method settings for the application or UI type, wherein
- the default targeting method settings provide settings for one or more default targeting methods, the one or more default targeting methods comprising types of UI descriptors.
A non-transitory computer-readable medium storing a computer program, the computer program configured to cause at least one processor to:
- automatically preconfigure default targeting method settings for an application or user interface (UI) type, by a designer application;
- configure one or more activities in a robotic process automation (RPA) workflow using the default targeting method settings for the application or UI type;
- and
- generate an RPA robot to implement the RPA workflow comprising the one or more configured activities, wherein
- the default targeting method settings provide settings for one or more default targeting methods, the one or more default targeting methods comprising types of UI descriptors.
Dependencies are inferred from the claim text.