# US 2025/0296233 A1 · Robot, robot control method, and computer program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0296233 A1
- Document ID: US20250296233A1
- Status: Published application
- Kind: A1
- Application number: 18/867,895
- Filed: 2022-10-07
- Published: 2025-09-25
- Earliest claimed: 2022-05-24
- Assignees: National University Corporation Tokai National Higher Education and Research System
- Applicants: National University Corporation Tokai National Higher Education and Research System
- Inventors: Takuro YONEZAWA; Nobuo KAWAGUCHI; Kenta URANO; Yutaro KYONO
- Web page: https://patentgrep.com/patent/US20250296233A1

## CPC

- B25J 9/1689: {Teleoperation}
- B25J 9/1602: {characterised by the control system, structure, architecture}
- B25J 9/162: {Mobile manipulator, movable base with manipulator arm mounted on it}
- B25J 19/04: Viewing devices
- B25J 9/1697: {Vision controlled systems}
- G05B 2219/36167: Use camera of handheld device, pda, pendant, head mounted display
- G05B 2219/40125: Overlay real time stereo image of object on existing, stored memory image argos
- G05B 2219/40131: Virtual reality control, programming of manipulator
- G05B 2219/40146: Telepresence, teletaction, sensor feedback from follower to operator
- G05B 2219/40161: Visual display of machining, operation, remote viewing
- G05B 2219/40168: Simulated display of remote site, driven by operator interaction
- G05B 2219/40169: Display of actual situation at the remote site
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

A robot includes a display, a camera, a communication interface, a moving mechanism, and a control unit. The control unit includes a movement control unit, a remote video image processing unit, and a local video image processing unit. The movement control unit controls the moving mechanism to move the robot. The remote video image processing unit acquires a remote video image including video images representing a plurality of remote users located at sites different from the current location of the robot from an external network via a communication interface, and displays the acquired remote video image on the display. The local video image processing unit transmits a local video image, which is a video image captured by the camera, to the external network via the communication interface to cause the plurality of remote users to view the local video image.

## Claims

### Claim 1

A robot, comprising:
a display;
a camera;
a communication interface;
a moving mechanism for moving the robot; and
a control unit,
wherein the control unit includes:
a movement control unit that controls the moving mechanism to move the robot;
a remote video image processing unit that acquires a remote video image including video images representing a plurality of remote users located at sites different from the current location of the robot from an external network via the communication interface and displays the acquired remote video image on the display; and
a local video image processing unit that transmits a local video image, which is a video image captured by the camera, to the external network via the communication interface to cause the plurality of remote users to view the local video image.

### Claim 2 (depends on 1)

The robot according to claim 1,
wherein the control unit further includes an information space construction unit that constructs an information space shared by the plurality of remote users on the external network, and
wherein the local video image processing unit projects the local video image to the information space to cause the plurality of remote users virtually located in the information space to view the local video image.

### Claim 3 (depends on 2)

The robot according to claim 2,
wherein the remote video image includes video images of avatars of the plurality of remote users.

### Claim 4 (depends on 1)

The robot according to claim 1,
wherein the display is a 360 degree display.

### Claim 5 (depends on 1)

The robot according to claim 1,
wherein the camera is a 360 degree camera.

### Claim 6 (depends on 1)

The robot according to claim 1, the robot further comprising:
a 360 degree microphone,
wherein the control unit further includes a local sound processing unit that transmits the local sound, which is the sound acquired by the 360 degree microphone, to the external network via the communication interface to cause the plurality of remote users to hear the sound in a manner in which the direction of the source of the sound is recognizable.

### Claim 7 (depends on 1)

The robot according to claim 1, the robot further comprising:
a directional speaker,
wherein the control unit further includes a remote sound processing unit that acquires remote sound, which is a sound emitted from the plurality of remote users, from the external network via the communication interface, and outputs the acquired remote sound from the directional speaker in a manner in which the direction of the remote users is recognizable.

### Claim 8 (depends on 1)

The robot according to claim 1, further comprising:
a robot arm,
wherein the control unit further includes a robot arm control unit that receives operation instructions from the plurality of remote users from the external network via the communication interface and operates the robot arm in response to the received operation instructions.

### Claim 9

A robot control method for controlling a robot having a display, a camera, a communication interface, and a moving mechanism, comprising:
a step of controlling the moving mechanism to move the robot;
a step of acquiring a remote video image including video images representing a plurality of remote users located at sites different from the current location of the robot from an external network via the communication interface, and displaying the acquired remote video image on the display; and
a step of transmitting a local video image, which is a video image captured by the camera, to the external network via the communication interface to cause the plurality of remote users to view the local video image.

### Claim 10

A computer program for controlling a robot having a display, a camera, a communication interface, and a moving mechanism,
the computer program causing a computer to perform:
a process of controlling the moving mechanism to move the robot;
a process of acquiring a remote video image including video images representing a plurality of remote users located at sites different from the current location of the robot from an external network via the communication interface, and displaying the acquired remote video image on the display; and
a process of transmitting a local video image, which is a video image captured by the camera, to the external network via the communication interface to cause the plurality of remote users to view the local video image.
