Generalizable instruction following with pre-trained language and grounding models
AssigneeHonda Motor Co., Ltd.
InventorsGaoussou Youssouf KEBE, Kwonjoon LEE, Teruhisa MISU
Life of this patent
Estimating the term…
Loading patent…
AssigneeHonda Motor Co., Ltd.
InventorsGaoussou Youssouf KEBE, Kwonjoon LEE, Teruhisa MISU
Estimating the term…
Systems and methods for generalizable instruction following are provided. In one embodiment, a method includes generating a plurality of abstract tuples based on a set of instructions. The method includes classifying each abstract tuple of the plurality of abstract tuples as a navigation abstract tuple, an executable interaction abstract tuple, or a complex interaction abstract tuple based on the action. The method includes discarding the abstract tuples classified as navigation abstract tuples. The method includes forming set of executable interactions including the executable interaction abstract tuple. The method includes detecting an object location for the at least one object. The method includes decoding the complex interaction abstract tuples into executable interaction abstract tuples. The method includes adding the decoded executable interaction abstract tuples to the set of executable interactions. The method includes generating an executable plan for an agent based on the set of executable interactions and the object location.
A system for generalizable instruction following, comprising:
A method for generalizable instruction following, comprising:
A non-transitory computer readable storage medium storing instructions that when executed by a computer, which includes a processor perform a method, the method comprising:
Dependencies are inferred from the claim text.