Targeting functionality for integrating an RPA bot with an application
AssigneeNintex UK Ltd.
InventorsSasan Ehdaie, Kyle Claudy Dierking, Eric Herrera
Life of this patent
Estimating the term…
Abstract
Disclosed herein are systems and method for robotic-process-automation technology that trains botflows to successfully interact with application software, determine relevant sections of the application, and derive pertinent data from those sections. Such technology creates botflows that navigate various aspects of the application's environment to display or obtain additional data, as needed by the user. The botflows, after being trained to perform such actions, will effectively carry out such actions even after a minor change or update to the application.
Claims17
A method for training a device to successfully interact with an application, comprising:
- placing, by the device, a target mechanism over a first control of the application;
- capturing, by the device, a location of the target mechanism, wherein the target mechanism and the application are separate;
- acquiring, by the device and using the target mechanism location, a window handle of an application window below the target mechanism;
- ascertaining, by the device and using the window handle, a ClassName of the application window;
- determining, by the device and using the ClassName, whether the target mechanism is positioned above a GUI window of the application;
- responsive to determining the target mechanism is positioned above a GUI window of the application:
- (1) connecting the device to a GUI of the application;
- and
- (2) integrating the device to the application,
- wherein integrating the device to the application comprises the device being automated to interact with the application by:
- (i) obtaining, by the device, a GUI scripting API of the application;
- and
- (ii) generating, by the device, a live reference to the GUI using the GUI scripting API such that controls located within the application are accessible by the device;
- responsive to determining the target mechanism is not positioned above a GUI window of the application, preventing the integrating the device to the application;
- and
- listing the controls located within the application that are accessible by the device in a tree view format using the live reference to the GUI.
A non-transitory computer-readable medium storing instructions, the instructions comprising:
- one or more instructions that, when executed by one or more processors, cause the one or more processors to:
- place a target mechanism over a first control of an application;
- capture a location of the target mechanism, wherein the target mechanism and the application are separate;
- acquire, using the target mechanism location, a window handle of the application window below the target mechanism;
- ascertain, using the window handle, a ClassName of the application window;
- determine, using the ClassName, whether the target mechanism is positioned above a GUI window;
- responsive to determining the target mechanism is positioned above a GUI window of the application:
- connect to a GUI of the application;
- and
- integrate the one or more processors to the application,
- wherein integrating to the application comprises the one or more processors being automated to interact with the application by:
- (i) obtaining a GUI scripting API of the application;
- and
- (ii) generating a live reference to the GUI using the GUI scripting API such that controls located within the application are accessible by the one or more processors;
- responsive to determining the target mechanism is not positioned above a GUI window of the application, preventing the integration of the one or more processors to the application;
- and
- list the controls located within the application that are accessible by the one or more processors in a tree view format using the live reference to the GUI.
A system for training a device to successfully interact with an application comprising a non-transitory computer-readable medium having instructions stored thereon, which when executed by one or more processors of the system cause the system to:
- placing, by the device, a target mechanism over a first control of the application;
- capturing, by the device, a location of the target mechanism, wherein the target mechanism and the application are separate;
- acquiring, by the device and using the target mechanism location, a window handle of an application window below the target mechanism;
- ascertaining, by the device and using the window handle, a ClassName of the application window;
- determining, by the device and using the ClassName, whether the target mechanism is positioned above a GUI window of the application;
- responsive to determining the target mechanism is positioned above a GUI window of the application:
- connecting the device to a GUI of the application;
- and
- integrating the device to the application,
- wherein integrating the device to the application comprises the device being automated to interact with the application by:
- (i) obtaining, by the device, a GUI scripting API of the application;
- and
- (ii) generating, by the device, a live reference to the GUI using the GUI scripting API such that controls located within the application are accessible by the device;
- responsive to determining the target mechanism is not positioned above a GUI window of the application, preventing the integrating the device to the application;
- and
- listing the controls located within the application that are accessible by the device in a tree view format using the live reference to the GUI.
Dependencies are inferred from the claim text.