# US 2026/0099738 A1 · Probabilistic programming approach to intention estimation in human-robot teleoperated assembly tasks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0099738 A1
- Document ID: US20260099738A1
- Status: Published application
- Kind: A1
- Application number: 19/053,736
- Filed: 2025-02-14
- Published: 2026-04-09
- Earliest claimed: 2024-10-09
- Assignees: Honda Motor Co., Ltd.
- Applicants: Honda Motor Co., Ltd.
- Inventors: Aolin XU; Songpo LI; Prakash BASKARAN; Karankumar Ashokbhai PATEL; Soshi IBA
- Web page: https://patentgrep.com/patent/US20260099738A1

## CPC

- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 20/00: Machine learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method for probabilistic modeling for intention estimation in an operator-robot teleoperated assembly task is provided. The method may estimate the assembly task to be completed, wherein the assembly task comprises a sequence of actions. The method may predict a next action of the sequence of actions to be performed for the assembly task to be completed.

## Claims

### Claim 1

A method for probabilistic modeling for intention estimation in an operator-robot teleoperated assembly task, comprising:
estimating the assembly task to be completed, wherein the assembly task comprises a sequence of actions; and
predicting a next action of the sequence of actions to be performed for the assembly task to be completed.

### Claim 2 (depends on 1)

The method of claim 1, comprising forming a probabilistic graphical model for estimating the assembly task and predicting the next action of the sequence of actions.

### Claim 3 (depends on 1)

The method of claim 1, comprising forming a probabilistic graphical model to represent a joint distribution of the assembly task and all actions needed to be taken to complete the assembly task.

### Claim 4 (depends on 1)

The method of claim 1, comprising forming a probabilistic graphical model to represent a joint distribution of the assembly task and all actions needed to be taken to complete the assembly task, wherein probabilistic graphical model learning is done through variation and probabilistic graphical model inference is done through structured marginalization.

### Claim 5 (depends on 1)

The method of claim 1, comprising using a probabilistic programming language to form a probabilistic graphical model to represent a joint distribution of the assembly task and all actions needed to be taken to complete the assembly task, wherein probabilistic graphical model learning is done through variation and probabilistic graphical model inference is done through structured marginalization.

### Claim 6 (depends on 5)

The method of claim 5, wherein the probabilistic programming language is Pyro.

### Claim 7 (depends on 2)

The method of claim 2, comprising modeling individual distributions of the assembly task and all the actions taken at different times in completing the assembly task.

### Claim 8 (depends on 2)

The method of claim 2, comprising using a pretrained action recognition module for training the assembly task.

### Claim 9 (depends on 3)

The method of claim 3, comprising using a pretrained action recognition module for training the assembly task solely based on an instruction manual of the assembly task.

### Claim 10 (depends on 1)

The method of claim 1, comprising:
treating the assembly task and the sequence of actions as jointly distributed random variables; and
constructing a joint distribution of the random variables, wherein the joint distribution of the random variables comprises a model structure and model parameters, wherein the model structure reflects dependencies among the random variables and determines how the joint distribution factorizes into a product of individual distributions of the random variables, and individual distribution of each random variable is one of a marginal distribution of a specific random variable when not influenced by other random variables, or a transition distribution conditional on random variables that influence the specific random variable, wherein the model parameters includes marginal distribution and all the transition distributions.

### Claim 11 (depends on 10)

The method of claim 10, comprising learning the model parameters, wherein learning the model parameters comprises learning unknown individual distributions, from a dataset.

### Claim 12 (depends on 10)

The method of claim 10, comprising:
representing each individual distribution as one of a single finite dimensional probability vector or multiple finite dimensional probability vectors, wherein each single finite dimensional probability vector and each multiple finite dimensional probability vectors are treated as random quantities; and
finding a posterior distribution of each single finite dimensional probability vector and each multiple finite dimensional probability vectors given the dataset.

### Claim 13 (depends on 12)

The method of claim 12, wherein finding the posterior distribution of each single finite dimensional probability vector and each multiple finite dimensional probability vectors given the dataset is calculated in Pyro via stochastic variational inference (SVI).

### Claim 14 (depends on 10)

The method of claim 10, comprising outputting recognized actions in continuous time with uniform sampling interval using an action recognition module, wherein the output is the same during execution of an action with sporadic recognition errors.

### Claim 15 (depends on 14)

The method of claim 14, comprising extracting distinct actions from the recognized actions.

### Claim 16

A method for probabilistic modeling for intention estimation in an operator-robot teleoperated assembly task, the method implemented using a computer system including a processor communicatively coupled to a memory device, the method comprising:
estimating the assembly task to be completed, wherein the assembly task comprises a sequence of actions;
predicting a next action of the sequence of actions to be performed for the assembly task to be completed; and
forming a probabilistic graphical model to represent a joint distribution of the assembly task and all actions needed to be taken to complete the assembly task, wherein probabilistic graphical model learning is done through variation and probabilistic graphical model inference is done through structured marginalization.

### Claim 17 (depends on 16)

The method of claim 16, comprising forming the probabilistic graphical model using a probabilistic programming language, wherein the probabilistic programming language is Pyro.

### Claim 18 (depends on 16)

The method of claim 16, comprising modeling individual distributions of the assembly task and all the actions taken at different times in completing the assembly task.

### Claim 19 (depends on 16)

The method of claim 16, comprising using a pretrained action recognition module for training the assembly task solely based on an instruction manual of the assembly task.

### Claim 20

A method for probabilistic modeling for intention estimation in an operator-robot teleoperated assembly task, comprising:
estimating the assembly task to be completed, wherein the assembly task comprises a sequence of actions;
predicting a next action of the sequence of actions to be performed for the assembly task to be completed;
treating the assembly task and the sequence of actions as jointly distributed random variables;
constructing a joint distribution of the random variables, wherein the joint distribution of the random variables comprises a model structure and model parameters, wherein the model structure reflects dependencies among the random variables and determines how the joint distribution factorizes into a product of individual distributions of the random variables, and individual distribution of each random variable is one of a marginal distribution of a specific random variable when not influenced by other random variables, or a transition distribution conditional on random variables that influence the specific random variable, wherein the model parameters includes marginal distribution and all the transition distributions;
representing each individual distribution as one of a single finite dimensional probability vector or multiple finite dimensional probability vectors, wherein each single finite dimensional probability vector and each multiple finite dimensional probability vectors are treated as random quantities;
finding a posterior distribution of each single finite dimensional probability vector and each multiple finite dimensional probability vectors given the dataset, wherein finding the posterior distribution of each single finite dimensional probability vector and each multiple finite dimensional probability vectors given the dataset is calculated in Pyro via stochastic variational inference (SVI);
outputting recognized actions in continuous time with uniform sampling interval using an action recognition module, wherein the output is the same during execution of an action with sporadic recognition errors; and
extracting distinct actions from the recognized actions.
