# US 2024/0267570 A1 · Virtual live streaming method and apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0267570 A1
- Document ID: US20240267570A1
- Status: Published application
- Kind: A1
- Application number: 18/400,898
- Filed: 2023-12-29
- Published: 2024-08-08
- Earliest claimed: 2022-12-30
- Assignees: Shanghai Bilibili Technology Co., Ltd.
- Applicants: Shanghai Bilibili Technology Co., Ltd.
- Inventors: Huaizhou ZHANG; Shaoxiong GUO; Yang MING
- Web page: https://patentgrep.com/patent/US20240267570A1

## CPC

- H04N 21/2187: Live feed
- G06V 40/174: {Facial expression recognition}
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- Y02D 30/70: in wireless communication networks
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

The present application provides techniques for virtual live streaming. The techniques comprise loading at least two virtual images in a current live streaming room in response to a request for adding the at least two virtual images; generating a unique identifier corresponding to each of the at least two virtual images while loading each of the at least two virtual images; obtaining motion capture data indicative of motions to be applied in the current live streaming room; and performing virtual live streaming in the current live streaming room based on the at least two virtual images and the motion capture data.

## Claims

### Claim 1

A method for live streaming using virtual images, comprising:
loading at least two virtual images in a current live streaming room in response to a request for adding the at least two virtual images;
generating a unique identifier corresponding to each of the at least two virtual images while loading each of the at least two virtual images;
obtaining motion capture data indicative of motions to be applied in the current live streaming room; and
performing virtual live streaming in the current live streaming room based on the at least two virtual images and the motion capture data.

### Claim 2 (depends on 1)

The method according to claim 1, further comprising:
configuring different motion capture devices for the at least two virtual images, wherein each of the different motion capture devices is configured to obtain motion capture data corresponding to each of the least two virtual images.

### Claim 3 (depends on 1)

The method according to claim 1, further comprising:
storing each of the at least two virtual images and the unique identifier corresponding to each of the at least two virtual images by using a hash table.

### Claim 4 (depends on 1)

The method according to claim 1, further comprising:
configuring each of the at least two virtual images by performing live streaming configuration on each of the at least two virtual images; and
performing the virtual live streaming in the current live streaming room based on the at least two virtual images, the motion capture data, and the live streaming configuration.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the configuring each of the at least two virtual images further comprises:
selecting a target virtual image and obtaining a unique identifier of the target virtual image, wherein the target virtual image is any one of the at least two virtual images;
obtaining at least one configuration option corresponding to the target virtual image based on the unique identifier of the target virtual image; and
configuring the target virtual image based on an input instruction corresponding to the at least one configuration option.

### Claim 6 (depends on 5)

The method according to claim 5, further comprising:
in response to determining that a configuration of the target virtual image is updated, refreshing rendering of the target virtual image based on motion capture data and updated configuration corresponding to the target virtual image.

### Claim 7 (depends on 4)

The method according to claim 4, wherein the live streaming configuration comprises a facial expression configuration, wherein the facial expression configuration is configured to drive a corresponding virtual image among the at least two virtual images to perform a preset facial expression motion based on a preset instruction, and wherein the method further comprises:
driving a target virtual image to perform the preset facial expression motion in response to determining that the target virtual image is configured with the facial expression configuration and that the preset instruction is received, wherein the target virtual image is any one of the at least two virtual images.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the preset facial expression motion comprises switching the target virtual image to a preset virtual image.

### Claim 9 (depends on 4)

The method according to claim 4, wherein the live streaming configuration is configured to enable or disable input of motion capture data to a corresponding virtual image among the least two virtual images, and wherein the method further comprises:
disabling input of motion capture data to a target virtual image in response to determining that a live streaming configuration of the target virtual image is disabled, wherein the target virtual image is any one of the at least two virtual images; and
performing the virtual live streaming in the current live streaming room based on the motion capture data, the live streaming configuration, and at least one other virtual image than the target virtual image.

### Claim 10

A computing device, comprising a memory and a processor, wherein the memory stores computer-readable instructions that upon execution by the processor cause the processor to perform operations comprising:
loading at least two virtual images in a current live streaming room in response to a request for adding the at least two virtual images;
generating a unique identifier corresponding to each of the at least two virtual images while loading each of the at least two virtual images;
obtaining motion capture data indicative of motions to be applied in the current live streaming room; and
performing virtual live streaming in the current live streaming room based on the at least two virtual images and the motion capture data.

### Claim 11 (depends on 10)

The computing device according to claim 10, the operations further comprising:
configuring different motion capture devices for the at least two virtual images, wherein each of the different motion capture devices is configured to obtain motion capture data corresponding to each of the least two virtual images.

### Claim 12 (depends on 10)

The computing device according to claim 10, the operations further comprising:
storing each of the at least two virtual images and the unique identifier corresponding to each of the at least two virtual images by using a hash table.

### Claim 13 (depends on 10)

The computing device according to claim 10, the operations further comprising:
configuring each of the at least two virtual images by performing live streaming configuration on each of the at least two virtual images; and
performing the virtual live streaming in the current live streaming room based on the at least two virtual images, the motion capture data, and the live streaming configuration.

### Claim 14 (depends on 13)

The computing device according to claim 13, wherein the configuring each of the at least two virtual images further comprises:
selecting a target virtual image and obtaining a unique identifier of the target virtual image, wherein the target virtual image is any one of the at least two virtual images;
obtaining at least one configuration option corresponding to the target virtual image based on the unique identifier of the target virtual image; and
configuring the target virtual image based on an input instruction corresponding to the at least one configuration option.

### Claim 15 (depends on 13)

The computing device according to claim 13, wherein the live streaming configuration comprises a facial expression configuration, wherein the facial expression configuration is configured to drive a corresponding virtual image among the at least two virtual images to perform a preset facial expression motion based on a preset instruction, and wherein the operations further comprise:
driving a target virtual image to perform the preset facial expression motion in response to determining that the target virtual image is configured with the facial expression configuration and that the preset instruction is received, wherein the target virtual image is any one of the at least two virtual images.

### Claim 16 (depends on 13)

The computing device according to claim 13, wherein the live streaming configuration is configured to enable or disable input of motion capture data to a corresponding virtual image among the least two virtual images, and wherein the operations further comprise:
disabling input of motion capture data to a target virtual image in response to determining that a live streaming configuration of the target virtual image is disabled, wherein the target virtual image is any one of the at least two virtual images; and
performing the virtual live streaming in the current live streaming room based on the motion capture data, the live streaming configuration, and at least one other virtual image than the target virtual image.

### Claim 17

A non-transitory computer-readable storage medium, storing computer-readable instructions that upon execution by a processor cause the processor to implement operations comprising:
loading at least two virtual images in a current live streaming room in response to a request for adding the at least two virtual images;
generating a unique identifier corresponding to each of the at least two virtual images while loading each of the at least two virtual images;
obtaining motion capture data indicative of motions to be applied in the current live streaming room; and
performing virtual live streaming in the current live streaming room based on the at least two virtual images and the motion capture data.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium according to claim 17, the operations further comprising:
configuring different motion capture devices for the at least two virtual images, wherein each of the different motion capture devices is configured to obtain motion capture data corresponding to each of the least two virtual images.

### Claim 19 (depends on 17)

The non-transitory computer-readable storage medium according to claim 17, the operations further comprising:
configuring each of the at least two virtual images by performing live streaming configuration on each of the at least two virtual images; and
performing the virtual live streaming in the current live streaming room based on the at least two virtual images, the motion capture data, and the live streaming configuration.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium according to claim 19, wherein the live streaming configuration is configured to enable or disable input of motion capture data to a corresponding virtual image among the least two virtual images, and wherein the operations further comprise:
disabling input of motion capture data to a target virtual image in response to determining that a live streaming configuration of the target virtual image is disabled, wherein the target virtual image is any one of the at least two virtual images; and
performing the virtual live streaming in the current live streaming room based on the motion capture data, the live streaming configuration, and at least one other virtual image than the target virtual image.
