Graphical element search technique selection, fuzzy logic selection of anchors and targets, and/or hierarchical graphical element identification for robotic process automation

A computer-implemented method for identifying a target user interface (UI) element associated with an activity of a robotic process automation (RPA) workflow, comprising:

• executing in parallel a selector search and at least two of a fuzzy selector search, a target and anchor search, a fuzzy target and anchor search, image matching, text matching, and computer vision (CV) matching for the target UI element at runtime, by an RPA robot configured to implement the RPA workflow;
• selecting a best result from the selector search and the at least one of the fuzzy selector search, the target and anchor search, the fuzzy target and anchor search, the image matching, the text matching, and the CV matching based on validation scores, by the RPA robot, to identify the target UI element;
• and
• performing an interaction with the identified target UI element, by the RPA robot, based on the activity of the RPA workflow.

A non-transitory computer-readable medium storing a computer program for identifying a target user interface (UI) element associated with an activity of a robotic process automation (RPA) workflow, the computer program configured to cause at least one processor to:

• execute a selector search for the target UI element at runtime to identify the target UI element, and responsive to the target UI element not being found, execute at least one other search algorithm to identify the target UI element and perform an interaction with the identified target UI element based on the activity of the RPA workflow;
• or
• execute the selector search and the at least one other search algorithm, select a best result from the selector search and the at least one other search algorithm based on validation scores to identify the target UI element, and perform the interaction with the identified target UI element based on the activity of the RPA workflow, wherein
• the at least one other search algorithm comprises a fuzzy selector search, a target and anchor search, a fuzzy target and anchor search, image matching, text matching, computer vision (CV) matching, or a combination thereof, wherein
• the at least one other search algorithm comprises at least two search algorithms, and
• the at least two search algorithms are performed in parallel.