Autonomous task performance based on visual embeddings
AssigneeToyota Research Institute, Inc.
InventorsJeremy MA, Kevin STONE, Max BAJRACHARYA, Krishna SHANKAR
Life of this patent
Estimating the term…
Abstract
A method for controlling a robotic device is presented. The method includes capturing an image corresponding to a current view of the robotic device. The method also includes identifying a keyframe image comprising a first set of pixels matching a second set of pixels of the image. The method further includes performing, by the robotic device, a task corresponding to the keyframe image.
Claims20
A method for controlling a robotic device, comprising:
- capturing an image corresponding to a current view of the robotic device;
- identifying a keyframe image comprising a first set of pixels matching a second set of pixels of the image;
- and
- performing, by the robotic device, a task corresponding to the keyframe image.
A robotic device, comprising:
- a memory;
- and
- at least one processor, the at least one processor configured:
- to capture an image corresponding to a current view of the robotic device;
- to identify a keyframe image comprising a first set of pixels matching a second set of pixels of the image;
- and
- to perform a task corresponding to the keyframe image.
A non-transitory computer-readable medium having program code recorded thereon for controlling a robotic device, the program code comprising:
- program code to capture an image corresponding to a current view of the robotic device;
- program code to identify a keyframe image comprising a first set of pixels matching a second set of pixels of the image;
- and
- program code to perform, by the robotic device, a task corresponding to the keyframe image.
Dependencies are inferred from the claim text.