Vision-language model for detecting and reasoning over failures in robotic manipulation
AssigneeNVIDIA Corporation
InventorsJiafei Duan, Yijie Guo, Ajay Mandlekar, Dieter Fox
Life of this patent
Estimating the term…
Loading patent…
AssigneeNVIDIA Corporation
InventorsJiafei Duan, Yijie Guo, Ajay Mandlekar, Dieter Fox
Estimating the term…
Foundation models such as VLMs and LLMs are increasingly being used to address open-world tasks in robotics. While these models excel at task execution, they often face challenges in detecting and reasoning over failures, which are skills that are crucial for navigating dynamic and complex environments. The present disclosure provides a VLM that detects and reasons about failures in robotic manipulation using natural language, where the natural language feedback can then be used for improving downstream task performance through error correction.
A method, comprising:
A system, comprising:
A non-transitory computer-readable media storing computer instructions which when executed by one or more processors of a device cause the device to:
A method, comprising:
A method, comprising:
Dependencies are inferred from the claim text.