Probabilistic programming approach to intention estimation in human-robot teleoperated assembly tasks
AssigneeHonda Motor Co., Ltd.
InventorsAolin XU, Songpo LI, Prakash BASKARAN, Karankumar Ashokbhai PATEL, Soshi IBA
Life of this patent
Estimating the term…
Abstract
A method for probabilistic modeling for intention estimation in an operator-robot teleoperated assembly task is provided. The method may estimate the assembly task to be completed, wherein the assembly task comprises a sequence of actions. The method may predict a next action of the sequence of actions to be performed for the assembly task to be completed.
Claims20
A method for probabilistic modeling for intention estimation in an operator-robot teleoperated assembly task, comprising:
- estimating the assembly task to be completed, wherein the assembly task comprises a sequence of actions;
- and
- predicting a next action of the sequence of actions to be performed for the assembly task to be completed.
A method for probabilistic modeling for intention estimation in an operator-robot teleoperated assembly task, the method implemented using a computer system including a processor communicatively coupled to a memory device, the method comprising:
- estimating the assembly task to be completed, wherein the assembly task comprises a sequence of actions;
- predicting a next action of the sequence of actions to be performed for the assembly task to be completed;
- and
- forming a probabilistic graphical model to represent a joint distribution of the assembly task and all actions needed to be taken to complete the assembly task, wherein probabilistic graphical model learning is done through variation and probabilistic graphical model inference is done through structured marginalization.
A method for probabilistic modeling for intention estimation in an operator-robot teleoperated assembly task, comprising:
- estimating the assembly task to be completed, wherein the assembly task comprises a sequence of actions;
- predicting a next action of the sequence of actions to be performed for the assembly task to be completed;
- treating the assembly task and the sequence of actions as jointly distributed random variables;
- constructing a joint distribution of the random variables, wherein the joint distribution of the random variables comprises a model structure and model parameters, wherein the model structure reflects dependencies among the random variables and determines how the joint distribution factorizes into a product of individual distributions of the random variables, and individual distribution of each random variable is one of a marginal distribution of a specific random variable when not influenced by other random variables, or a transition distribution conditional on random variables that influence the specific random variable, wherein the model parameters includes marginal distribution and all the transition distributions;
- representing each individual distribution as one of a single finite dimensional probability vector or multiple finite dimensional probability vectors, wherein each single finite dimensional probability vector and each multiple finite dimensional probability vectors are treated as random quantities;
- finding a posterior distribution of each single finite dimensional probability vector and each multiple finite dimensional probability vectors given the dataset, wherein finding the posterior distribution of each single finite dimensional probability vector and each multiple finite dimensional probability vectors given the dataset is calculated in Pyro via stochastic variational inference (SVI);
- outputting recognized actions in continuous time with uniform sampling interval using an action recognition module, wherein the output is the same during execution of an action with sporadic recognition errors;
- and
- extracting distinct actions from the recognized actions.
Dependencies are inferred from the claim text.