# US 12,602,868 B2 · Remote reproduction method, system, and apparatus, device, medium, and program product

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,602,868 B2
- Document ID: US12602868B2
- Status: Granted
- Kind: B2
- Application number: 18/358,228
- Filed: 2023-07-25
- Published: 2023-11-16
- Granted: 2026-04-14
- Earliest claimed: 2021-01-26
- Assignees: Huawei Cloud Computing Technologies Co., Ltd.
- Applicants: Huawei Cloud Computing Technologies Co., Ltd.
- Inventors: Weimeng Gong; Jun Li; Dandan Tu
- Web page: https://patentgrep.com/patent/US12602868B2

## CPC

- G06T 17/05: Geographic models
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 7/251: {involving models}
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06V 10/46: Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features (colour feature extraction G06V10/56)
- G06V 10/75: Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V 20/20: in augmented reality scenes
- G06V 40/174: {Facial expression recognition}
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04L 67/131: Protocols for games, networked simulations or virtual reality
- H04N 7/157: {defining a virtual conference space and using avatars or agents (computer conference optimisation or adaptation H04L12/1827)}
- G06T 2207/10048: Infrared image
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30196: Human being; Person
- G16H 40/67: for remote operation
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

This application provides a remote reproduction method, applied to a remote reproduction system, where the system includes a first terminal worn by a first user and a second terminal worn by a second user, and the first user and the second user are located in different geographical locations. According to the method the second terminal obtains an action image of the first user, where the action image of the first user includes a sequence of at least one action formed by a pre-constructed human body model of the first user, and then the second terminal reproduces, for the second user, the action image of the first user at a geographical location in which the second user is located.

## Claims

### Claim 1

A remote reproduction method applied to a remote reproduction system comprising a server, a first terminal worn by a first user, and a second terminal worn by a second user, the first and second users being located in different geographical locations, the method comprising:
obtaining a multi-angle image of the first user;
performing a reconstruction based on the multi-angle image to obtain a human body model of the user;
obtaining, by the second terminal, an action image of the first user, wherein the action image of the first user comprises a sequence of at least two actions formed by the human body model of the first user; and
reproducing, for the second user by the second terminal, the action image of the first user.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the method further comprises:
obtaining, by the server, location information of a key point of the first user; determining, by the server, a movement track of the key point based on the location information of the key point; obtaining, by the server, the action image based on the movement track and the human body model of the first user that is stored in the server; and sending, by the server, the action image to the second terminal.

### Claim 3 (depends on 2)

The method according to claim 2, wherein obtaining the location information of the key point comprises:
obtaining, by the server, an image of a key part of the first user, and obtaining location information of the key point based on the image of the key part.

### Claim 4 (depends on 2)

The method according to claim 2, wherein obtaining the location information of the key point of the first user comprises:
obtaining, by the server from a pose sensor deployed at a key part of the first user, the location information of the key point corresponding to the key part.

### Claim 5 (depends on 1)

The method according to claim 1, further comprising:
obtaining, by the first terminal, an image of the geographical location in which the second user is located; and
reproducing, by the first terminal, the image of the geographical location in which the second user is located.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the first terminal is a virtual reality terminal, and the second terminal is an augmented reality terminal.

### Claim 7 (depends on 1)

The method according to claim 1, further comprising:
obtaining, by the first terminal, an action image of the second user, wherein the action image of the second user comprises a sequence of at least two actions formed by a human body model of the second user, and the human body model of the second user is a pre-constructed model; and
reproducing, for the first user by the first terminal, the action image of the second user.

### Claim 8 (depends on 1)

The method according to claim 1, wherein the first terminal and the second terminal are virtual reality terminals.

### Claim 9 (depends on 1)

The method according to claim 1, further comprising:
obtaining, by the first terminal, location information of a key point of the first user;
determining, by the first terminal, a movement track of the key point based on the location information of the key point; and
obtaining, by the first terminal, the action image based on the movement track and the human body model that is stored in the first terminal.

### Claim 10 (depends on 1)

The method according to claim 1, wherein the human body model is a three-dimensional human body model, and the action image is a three-dimensional action image.

### Claim 11

A remote reproduction system comprising:
a first terminal worn by a first user, and a second terminal worn by a second user, the first and second users being located in different geographical locations; and
a server configured to obtain a multi-angle image of the first user, and perform a reconstruction based on the multi-angle image to obtain a human body model of the user; wherein
the second terminal is configured to obtain an action image of the first user, and reproduce, for the second user, the action image of the first user, wherein the action image of the first user comprises a sequence of at least two actions formed by the human body model of the first user.

### Claim 12 (depends on 11)

The system according to claim 11, wherein the server
is further configured to obtain location information of a key point of the first user, determine a movement track of the key point based on the location information of the key point, obtain the action image based on the movement track and the human body model of the first user that is stored in the server, and send the action image to the second terminal.

### Claim 13 (depends on 12)

The system according to claim 12, wherein the server is additionally configured to:
obtain an image of a key part of the first user, and obtain location information of the key point based on the image of the key part.

### Claim 14 (depends on 12)

The system according to claim 12, wherein the server is additionally configured to:
obtain, from a pose sensor deployed at a key part of the first user, the location information of the key point corresponding to the key part.

### Claim 15 (depends on 11)

The system according to claim 11, wherein the first terminal is further configured to:
obtain an image of the geographical location in which the second user is located; and
reproduce, for the first user, the image of the geographical location in which the second user is located.

### Claim 16 (depends on 11)

The system according to claim 11, wherein the first terminal is a virtual reality terminal, and the second terminal is an augmented reality terminal.

### Claim 17 (depends on 11)

The system according to claim 11, wherein the first terminal is further configured to:
obtain an action image of the second user, wherein the action image of the second user comprises a sequence of at least two actions formed by a human body model of the second user, and the human body model of the second user is a pre-constructed model; and
reproduce, for the first user, the action image of the second user.

### Claim 18 (depends on 11)

The system according to claim 11, wherein the first terminal and the second terminal are virtual reality terminals.

### Claim 19 (depends on 11)

The system according to claim 11, wherein the first terminal is further configured to:
obtain location information of a key point of the first user;
determine a movement track of the key point based on the location information of the key point; and
obtain the action image based on the movement track and the human body model of the first user that is stored in the first terminal.

### Claim 20 (depends on 11)

The system according to claim 11, wherein the human body model is a three-dimensional human body model, and the action image is a three-dimensional action image.

### Claim 21

A server comprising:
a processor and a memory, the processor being configured to execute instructions stored in the memory to:
obtain a multi-angle image of the first user;
perform a reconstruction based on the multi-angle image to obtain a human body model of the user;
obtain location information of a key point of the first user;
a movement track of the key point of the first user based on the location information of the key point of the first user;
obtaining an action image of the first user based on the movement track and a human body model of the first user, wherein the action image of the first user comprises a sequence of at least two actions formed by the human body model, and the human body model is a pre-constructed model; and
sending the action image to a second terminal, so that the second terminal reproduces, for a second user, the action image at a geographical location in which the second user is located, wherein the first user and the second user are located in different geographical locations.
