Back to results
US 9,616,568 B1Granted
Generating a grasp affordance for an object based on a thermal image of the object that is captured following human manipulation of the object
AssigneeX Development LLC
InventorJared Stephen Russell
Life of this patent
Estimating the term…
Abstract
Methods, apparatus, and computer readable storage media related to utilizing a thermographic camera to capture at least one thermal image of an object following human manipulation of the object, and generating a grasp affordance for the object based on the temperatures indicated by the captured thermal image. The generated grasp affordance may be utilized, directly or indirectly, by one or more robots for determining grasping parameters for manipulating the object and/or other objects that are similar to the object.
Claims21
A method, comprising:
- detecting an object based on data from one or more sensors of a robot;
- capturing, by a thermographic camera of the sensors of the robot, at least one thermal image of the object prior to expiration of a threshold amount of time following completion of manipulation of the object by a human;
- capturing, by the thermographic camera, at least one additional thermal image of the object, the additional thermal image of the object captured either before the manipulation of the object by the human or after expiration of the threshold amount of time following the completion of the manipulation of the object by the human;
- generating, by one or more processors, a grasp affordance for the object based on differences in temperatures indicated by the thermal image and the additional thermal image, the grasp affordance defining one or more portions of the object touched by the human during the manipulation of the object by the human;
- and
- storing the grasp affordance for the object in a non-transitory computer readable storage medium for determining one or more grasping parameters for manipulating the object or other objects that are similar to the object.
3 more elements
A method, comprising:
- capturing, by a thermographic camera, at least one thermal image of an object following manipulation of the object by a human;
- generating, by one or more processors, a grasp affordance for the object based on one or more temperatures indicated by the thermal image, the grasp affordance defining one or more portions of the object touched by the human during the manipulation of the object by the human;
- and
- storing the grasp affordance for the object in a non-transitory computer readable storage medium for determining one or more grasping parameters for one or more robots in manipulating the object or other objects that are similar to the object.
1 more element
A system, comprising:
- a thermographic camera capturing thermal images;
- one or more processors executing instructions stored in a non-transitory computer readable storage medium, wherein execution of the instructions cause the one or more processors to:
- receive at least one thermal image of the thermal images, the thermal image captured by the thermographic camera following completion of manipulation of the object by a human;
- generate a grasp affordance for the object based on one or more temperatures indicated by the thermal image, the grasp affordance defining one or more portions of the object touched by the human during the manipulation of the object by the human;
- and
- store the grasp affordance for the object in a non-transitory computer readable storage medium for determining one or more grasping parameters for one or more robots in manipulating the object or other objects that are similar to the object.
3 more elements
Dependencies are inferred from the claim text.