Teleoperating Of Robots With Tasks By Mapping To Human Operator Pose
AssigneeNimble Robotics, Inc.
InventorSimon Kalouche
Life of this patent
Estimating the term…
Abstract
A system enables teleoperation of a robot based on a pose of a subject. The system includes an image capturing device and an operator system controller that are remotely located from a robotic system controller and a robot. The image capturing device captures images of the subject. The operator system controller maps a processed version of the captured image to a three-dimensional skeleton model of the subject and generates body pose information of the subject in the captured image. The robotic system controller communicates with the operator system controller over a network. The robotic system controller generates a plurality of kinematic parameters for the robot and causes the robot to take a pose corresponding to the pose of the subject in the captured image.
Claims20
A method for training comprising:
- receiving, by one or more processors, teleoperator data corresponding to instructions for a robot to complete a first task;
- receiving, by the one or more processors, sensor data corresponding to an environment surrounding the robot;
- and
- training, by the one or more processors using the received teleoperator data and sensor data, a machine learning algorithm to predict future instructions for one or more robots to complete the first task.
A system for training a machine learning algorithm comprising:
- one or more computing devices storing an imitation learning engine, the imitation learning engine configured to:
- receive teleoperator data corresponding to instructions performed by a robot to complete a first task;
- receive sensor data corresponding to an environment surrounding the robot;
- and
- train, using the received teleoperator data and sensor data, a machine learning algorithm to predict future instructions for one or more robots to complete the first task.
Dependencies are inferred from the claim text.