# US 2026/0073803 A1 · Information processing apparatus, information processing method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073803 A1
- Document ID: US20260073803A1
- Status: Published application
- Kind: A1
- Application number: 19/125,318
- Filed: 2023-10-25
- Published: 2026-03-12
- Earliest claimed: 2022-11-07
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Andreas GEIER
- Web page: https://patentgrep.com/patent/US20260073803A1

## CPC

- G06N 3/08: Learning methods
- G09B 5/06: with both visual and audible presentation of the material to be studied
- G06N 3/092: Reinforcement learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

The present technology makes it possible to efficiently and quantitatively implement training for a human apprentice to learn a policy of an expert. An information processing apparatus includes processing circuitry configured to receive information corresponding to actions of a task by a first human, generate feedback by using a framework of imitation learning, the feedback indicating changes to the received actions of the task, the indicated changes being based on actions of a second human performing the task, and output information corresponding to the feedback to the first human who is performing the actions of the task.

## Claims

### Claim 1

An information processing apparatus, comprising:
processing circuitry configured to
receive information corresponding to actions of a task by a first human, generate feedback by using a framework of imitation learning, the feedback indicating changes to the received actions of the task, the indicated changes being based on actions of a second human performing the task, and
output information corresponding to the feedback to the first human who is performing the actions of the task.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to
repeatedly output the feedback while the first human is performing the actions of the task.

### Claim 3 (depends on 1)

The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to
obtain an observation value representing the actions of the first human and representing a state of an environment in which the first human performs the actions based on a detection result by a sensor.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein the processing circuitry is further configured to
identify a policy of the first human related to the task based on the actions of the first human and the time series data of the observation value.

### Claim 5 (depends on 4)

The information processing apparatus according to claim 4, wherein the processing circuitry is further configured to
end training for the first human in a case where the policy of the first human satisfies predetermined conditions.

### Claim 6 (depends on 1)

The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to
provide an evaluation value according to a difference between the action of the first human and the action of the second human to the first human or to the first human and the second human.

### Claim 7 (depends on 1)

The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to
receive the information corresponding to the actions of the task by the second human together with the actions of the first human, and
generate the feedback according to a difference between the action of the first human and the action of the second human by using a framework of behavior cloning as the imitation learning.

### Claim 8 (depends on 7)

The information processing apparatus according to claim 7, wherein the processing circuitry is further configured to
obtain an observation value representing the actions of each of the first human and the second human and representing a state of an environment in which the first human and the second human perform the actions based on the detection result by the sensor.

### Claim 9 (depends on 8)

The information processing apparatus according to claim 8, wherein the processing circuitry is further configured to
identify the policy of the first human related to the task based on the actions of the first human and the time series data of the observation value, and
identify the policy of the second human related to the task based on the actions of the second human and the time series data of the observation value.

### Claim 10 (depends on 3)

The information processing apparatus according to claim 3, wherein the processing circuitry is further configured to
obtain the policy of the second human related to the task acquired by the imitation learning before the training for the first human is started.

### Claim 11 (depends on 10)

The information processing apparatus according to claim 10, wherein the processing circuitry is further configured to
generate the feedback according to the difference between the action of the first human and the action of the second human determined to apply the observation value to the policy of the second human, using a framework of direct policy learning as the imitation learning.

### Claim 12 (depends on 11)

The information processing apparatus according to claim 11, wherein the processing circuitry is further configured to
identify the policy of the first human related to the task based on the actions of the first human and the time series data of the observation value, and
calculate the evaluation value based on the policy of the first human and the policy of the second human and provide the evaluation value to the first human or the first human and the second human.

### Claim 13 (depends on 10)

The information processing apparatus according to claim 10, wherein the processing circuitry is further configured to
estimate a reward function based on the policy of the second human and the actions of the second human by using a framework of inverse reinforcement learning as the imitation learning, and
generate the feedback according to a reward determined by applying the actions of the first human and the observation value to the reward function.

### Claim 14 (depends on 13)

The information processing apparatus according to claim 13, wherein the processing circuitry is further configured to
identify the policy of the first human related to the task based on the actions of the first human and the time series data of the observation value, and
calculate the evaluation value based on the policy of the first human and the policy of the second human and provide the evaluation value to the first human or the first human and the second human.

### Claim 15 (depends on 1)

The information processing apparatus according to claim 1, wherein the processing circuitry is further configured to
output the feedback by controlling at least one of a first device to be worn by the first human or a second device in an environment in which the first human performs the actions of the task.

### Claim 16 (depends on 15)

The information processing apparatus according to claim 15, wherein the processing circuitry is further configured to
control at least one of the first device or the second device to provide a stimulus to a sense of touch of the first human.

### Claim 17

An information processing method, comprising:
receiving information corresponding to actions of a task by a first human;
generating feedback by using a framework of imitation learning, the feedback indicating changes to the received actions of the task, the indicated changes being based on actions of a second human performing the task; and
outputting information corresponding to the feedback to the first human who is performing the actions of the task.

### Claim 18

A non-transitory computer-readable storage medium storing computer-readable instructions thereon which, when executed by a computer, cause the computer to perform a method, the method comprising:
receiving information corresponding to actions of a task by a first human; and
generating feedback by using a framework of imitation learning, the feedback indicating changes to the received actions of the task, the indicated changes being based on actions of a second human performing the task; and
outputting information corresponding to the feedback to the first human who is performing the actions of the task.

### Claim 19

A system, comprising:
a server; and
one or more information processing apparatuses communicably coupled to the server, each of the one or more information processing apparatuses including processing circuitry configured to receive information corresponding to actions of a task by a first human, transmit the information corresponding to the actions of the task to the server,
receive, from the server, feedback generated at the server by using a framework of imitation learning, the feedback indicating changes to the received actions of the task, the indicated changes being based on actions of a second human performing the task, and
output information corresponding to the feedback to the first human who is performing the actions of the task.

### Claim 20 (depends on 1)

The information processing apparatus of claim 1, wherein the processing circuitry for outputting information corresponding to the feedback is further configured to
transmit an electrical stimulus to a muscle of the first human to move the muscle of the first human in a predetermined direction based on the feedback.
