US 11,298,825 B2Granted

Systems, apparatus, and methods for robotic learning and execution of skills

AssigneeDiligent Robotics, Inc.

InventorsVivian Yaw-Wen Chu, Shuai Li, Forrest Green, Peter Worsnop, Andrea Lockerd Thomaz

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems, apparatus, and methods are described for robotic learning and execution of skills. A robotic apparatus can include a memory, a processor, sensors, and one or more movable components (e.g., a manipulating element and/or a transport element). The processor can be operatively coupled to the memory, the movable elements, and the sensors, and configured to obtain information of an environment, including one or more objects located within the environment. In some embodiments, the processor can be configured to learn skills through demonstration, exploration, user inputs, etc. In some embodiments, the processor can be configured to execute skills and/or arbitrate between different behaviors and/or actions. In some embodiments, the processor can be configured to learn an environmental constraint. In some embodiments, the processor can be configured to learn using a general model of a skill.

Claims30

Dependent claims

A robotic device, comprising:

a memory;
a processor;
a manipulating element;
and
a set of sensors,
the processor operatively coupled to the memory, the manipulating element, and the set of sensors, the processor configured to:
obtain, via a first subset of sensors from the set of sensors, a representation of an environment including at least one physical object;
obtain, via a second subset of sensors from the set of sensors, sensory information at each keyframe from a plurality of keyframes during a demonstration of a skill by a user in which the user demonstrates a physical interaction between the manipulating element and the at least one physical object, the set of sensory information including information of a set of features associated with the manipulating element and the environment, each keyframe of the plurality of keyframes representing a discrete point during the demonstration of the skill with at least two adjacent keyframes being separated from one another by a time interval;
present, via a user interface and to the user, the set of features such that the user can select a subset of the set of features that is relevant to learning the skill from the set of features;
and
generate a model for executing the skill using a subset of the set of sensory information that is associated with the subset of features selected by the user.

8 more elements

A robotic device, comprising:

a memory;
a processor;
a manipulating element;
a transport element configured to move along a surface;
and
a set of sensors,
the processor operatively coupled to the memory, the manipulating element, the transport element, and the set of sensors, the processor configured to:
obtain, via the set of sensors, information of an environment;
select, based on an arbitration algorithm or an input from a user, a skill to execute from a plurality of skills, the execution of the skill including a physical interaction between the manipulating element and a physical object in the environment;
generate, using a model for executing the skill, a first plan to execute the skill based on the information of the environment;
move the manipulating element and the transport element based on the first plan to execute at least a first portion of the skill while obtaining additional information of the environment;
in response to detecting a predefined change in the environment based on the additional information obtained of the environment, interrupt the execution of the skill;
prompt a user to provide an input based on the predefined change in the environment;
and
generate a second plan to execute a second portion of the skill based on the input.

12 more elements

A robotic device, comprising:

a memory;
a processor;
a manipulating element;
a transport element configured to move along a surface;
and
a set of sensors,
the processor operatively coupled to the memory, the manipulating element, the transport element, and the set of sensors, the processor configured to:
obtain, via the set of sensors, information of a first portion of an environment;
select, based on an arbitration algorithm or an input from a user, a skill to execute from a plurality of skills, the execution of the skill including a physical interaction between the manipulating element and a physical object in the environment;
generate, using a model for executing at least a first portion of the skill, a first plan to execute the first portion of the skill based on the information of the first portion of the environment;
move the manipulating element and the transport element based on the first plan to execute the first portion of the skill;
obtain, via the set of sensors, information of a second portion of an environment that is different from the first portion of the environment;
in response to determining that user input is required to execute a second portion of the skill in the second portion of the environment, prompt the user to provide at least one input associated with executing the second portion of the skill;
and
generate a second plan to execute the second portion of the skill based on the user input.

12 more elements

An apparatus, comprising:

a manipulating element;
a transport element configured to move along a surface;
a set of sensors;
a memory configured to store a map of an environment, the map including a static layer identifying locations of a first plurality of constraints in the environment and a dynamic layer identifying movements or behaviors of a second plurality of constraints in the environment, each constraint from the first and second plurality of constraints being associated with a physical object in the environment;
and
a processor operatively coupled to the memory, the manipulating element, the transport element, and the set of sensors, the processor configured to:
obtain, via the set of sensors, information of a portion of the environment;
select a skill to execute from a plurality of skills;
generate, using a model for executing the skill, a plan to execute the skill based on the information of the portion of the environment;
move the manipulating element and the transport element based on the plan to execute the skill;
obtain, after executing at least a portion of the skill, information of a constraint in the environment via the set of sensors;
determine a type of the constraint based on an input from a user or information of a set of physical objects stored in the memory;
and
store the information of the constraint and the type of constraint by updating the static and dynamic layers of the map.

11 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/504,130Filed 18 Oct 2021 · continuation
Priority: 25 Feb 2017
Published: US 2022/0032458 A13 Feb 2022
Granted: 12 Apr 2022
Term ends: Not estimatedThe source records don’t support an estimate.

Classification13 codes

B25J 9/1661
Characterised by programming, planning systems for manipulators: characterised by task planning, object-oriented languages
B25J 11/00
Manipulators not otherwise provided for
B25J 5/00
Manipulators mounted on wheels or on carriages
B25J 9/0081
Program-controlled manipulators: with leader teach-in means

Family

Application62/463,630Us provisional application · filed 25 Feb 2017
Application62/463,628Us provisional application · filed 25 Feb 2017
PCT/US2018/019520Parent of this continuation-in-part · filed 23 Feb 2018
Application62/723,694Us provisional application · filed 28 Aug 2018
Application16/456,919Parent of this continuation · filed 28 Jun 2019
US 2022/0032458 A1Pre-grant publication · published 3 Feb 2022
US 11,148,288 B2Parent of this continuation
Application16/456,919Parent of this continuation-in-part
US 2020/0070343 A1Published application
US 11,298,825 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key