Command and control interface for collaborative robotics
AssigneeCA, Inc.
InventorSerge Mankovskii
Life of this patent
Estimating the term…
Abstract
Aspects of the embodiments are directed to a real-time robot command and control interface. An aspect of the interface allows a user to select objects from an image of a scene and to reposition the objects within the scene. Another aspect of the interface can process the image data to determine one or more commands for instructing a robot to move the object to a desired location. The interface can use image and pattern recognition algorithms to determine the new location of the object and can use control algorithms to instruct the robot to move the object.
Claims23
A computer-implemented method for providing an interface for controlling a robot, the method comprising:
- receiving a captured image of a scene from a camera on a user device, the scene comprising an object;
- receiving an indication of an object selection;
- creating an image file representative of the object;
- providing the image file representative of the object for display over the image of the scene;
- receiving an indication of a repositioning of the object;
- storing an augmented image of the scene, the augmented image comprising an image of the object positioned at a new position;
- and
- transmitting the augmented image of the scene, the image file representative of the object, and the captured image of the scene to a robot command and control interface across a network connection.
A non-transitory computer readable medium having program instructions stored therein, wherein the program instructions are executable by a computer system to perform operations comprising:
- receiving a captured image of a scene from a camera on a user device, the scene comprising an object;
- receiving an indication of an object selection;
- creating an image file representative of the object;
- providing the image file representative of the object over the image of the scene for display;
- receiving an indication of a repositioning of the object;
- storing an augmented image of the scene, the augmented image comprising an image of the object positioned at a new position;
- and
- transmitting the augmented image of the scene, the image file representative of the object, and the captured image of the scene to a robot command and control interface across a network connection.
A computer-implemented method comprising:
- receiving, from a user device across a network connection, a captured image of a scene comprising an object, an image file representative of the object in the scene, and an augmented image file comprising an indication of a new position of the object in the scene;
- determining one or more commands for a robot to move the object to a position identified in the augmented image file;
- and
- transmitting the one or more commands to the robot.
A non-transitory computer readable medium having program instructions stored therein, wherein the program instructions are executable by a computer system to perform operations comprising:
- receiving, from a user device across a network connection, a captured image of a scene comprising an object;
- an image file representative of the object in the scene, and an augmented image file comprising an indication of a new position of the object in the scene;
- determining one or more commands for a robot to move the object to the position identified in the augmented image file;
- and
- transmitting the one or more commands to the robot.
Dependencies are inferred from the claim text.