# US 2025/0178209 A1 · Apparatus for generating motion control data for a robot for nonverbal communication and corresponding robot

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0178209 A1
- Document ID: US20250178209A1
- Status: Published application
- Kind: A1
- Application number: 18/842,399
- Filed: 2023-03-01
- Published: 2025-06-05
- Earliest claimed: 2022-03-18
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Mariko NISHIYAMA; Anja PFLUG; Gonzalo BAILADOR DEL POZO
- Web page: https://patentgrep.com/patent/US20250178209A1

## CPC

- B25J 9/1689: {Teleoperation}
- B25J 11/0005: {Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means}
- B25J 11/00: Manipulators not otherwise provided for
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G05B 2219/40142: Temperature sensation, thermal feedback to operator fingers
- G05B 2219/40146: Telepresence, teletaction, sensor feedback from follower to operator
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

An apparatus for generating motion control data for a robot is provided. The apparatus comprises input interface circuitry configured to receive first input data indicative of a target motion to be performed by a robot arm of the robot relative to a first user and receive second input data indicative of a breathing motion pattern of a second user. The apparatus further comprises processing circuitry configured to modify the target motion based on the breathing motion pattern and generate the motion control data, wherein the motion control data are indicative of the modified target motion. The apparatus further comprises output interface circuitry configured to output the motion control data.

## Claims

### Claim 1

An apparatus for generating motion control data for a robot, comprising:
input interface circuitry configured to:
receive first input data indicative of a target motion to be performed by a robot arm of the robot relative to a first user; and
receive second input data indicative of a breathing motion pattern of a second user;
processing circuitry configured to:
modify the target motion based on the breathing motion pattern; and
generate the motion control data, wherein the motion control data are indicative of the modified target motion; and
output interface circuitry configured to output the motion control data.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the input interface circuitry is further configured to receive third input data indicative of a phonation of the second user, and wherein the processing circuitry is further configured to modify the breathing motion pattern based on the phonation prior to modifying the target motion.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the processing circuitry is further configured to determine, based on the third input data, at least one of a predicted phonation and a predicted phonation break using a trained machine learning model, and wherein the processing circuitry is further configured to modify the breathing motion pattern based on the at least one of the predicted phonation and the predicted phonation break.

### Claim 4 (depends on 2)

The apparatus of claim 2, wherein the breathing motion pattern comprises an exhalation section, wherein the processing circuitry is configured to modify the breathing motion pattern by correlating a duration of the exhalation section with a duration of the phonation.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the processing circuitry is configured to modify the target motion by convolving the target motion and the breathing motion pattern.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the input interface circuitry is further configured to receive fourth input data indicative of a heartbeat pattern of the second user, wherein the processing circuitry is configured to modify the heartbeat pattern based on the breathing motion pattern, and wherein the output interface circuitry is further configured to output the modified heartbeat pattern.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the breathing motion pattern comprises an inhalation section and an exhalation section, wherein the processing circuitry is configured to modify the heartbeat pattern by clinching a first part of the heartbeat pattern corresponding to the inhalation section and stretching a second part of the heartbeat pattern corresponding to the exhalation section.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the target motion is to be performed by an actuator of the robot arm, wherein the processing circuitry is configured to modify the target motion based on a weighting of the breathing motion pattern, and wherein the weighting corresponds to a position of the actuator along the robot arm.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the input interface circuitry is further configured to receive fifth input data indicative of at least one of a motion of the first user, a position of the first user, a counterforce of the first user against the robot arm and settings of the first user, and wherein the processing circuitry is further configured to modify the target motion based on the fifth input data.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the first input data indicate at least one of a type of the target motion, a duration of the target motion and a target force to be applied on the first user by the robot arm.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the output interface circuitry is further configured to output second motion control data indicative of the breathing motion pattern.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein the input interface circuitry is further configured to receive sixth input data indicative of a target temperature to be regulated on by a heating device of the robot, and wherein the output interface circuitry is further configured to output temperature control data indicative of the target temperature.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the target temperature corresponds to a measured body temperature of the second user.

### Claim 14 (depends on 1)

The apparatus of claim 1, wherein the target motion is at least one of an enclosing of an upper body of the first user with the robot arm and a movement of a robot hand of the robot arm along a surface of the first user.

### Claim 15 (depends on 1)

The apparatus of claim 1, wherein the target motion is a measured motion of the second user.

### Claim 16

A robot, comprising:
a robot arm;
input interface circuitry configured to receive motion control data indicative of a target motion to be performed by the robot arm relative to a first user, wherein the target motion correlates with a breathing motion pattern of a second user; and
control circuitry configured to control movement of the robot arm based on the target motion.

### Claim 17 (depends on 16)

The robot of claim 16, wherein the input interface circuitry is further configured to receive second motion control data indicative of the breathing motion pattern of the second user, wherein the robot further comprises a robot chest comprising a hydraulic actuator or a pneumatic actuator, wherein the control circuitry is further configured to control the hydraulic actuator or the pneumatic actuator based on the breathing motion pattern.

### Claim 18 (depends on 16)

The robot of claim 16, wherein the input interface circuitry is configured to receive first input data indicative of at least one of a motion of the first user, a position of the first user, a counterforce of the first user against the robot arm and settings of the first user, and wherein the control circuitry is further configured to control the movement of the robot arm based on the first input data.

### Claim 19 (depends on 16)

The robot of claim 16, wherein the input interface circuitry is further configured to receive second input data indicative of a heartbeat pattern of the second user, wherein the robot further comprises a vibration actuator, and wherein the control circuitry is further configured to control the vibration actuator based on the heartbeat pattern.

### Claim 20 (depends on 19)

The robot of claim 19, wherein the heartbeat pattern correlates with the breathing motion pattern of the second user.
