# US 12,223,571 B2 · Data transmission method and related device for virtual reality system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,223,571 B2
- Document ID: US12223571B2
- Status: Granted
- Kind: B2
- Application number: 17/921,292
- Filed: 2021-07-05
- Published: 2023-06-15
- Granted: 2025-02-11
- Earliest claimed: 2020-08-26
- Assignees: Beijing Boe Optoelectronics Technology Co., Ltd.; Boe Technology Group Co., Ltd.
- Applicants: Beijing BOE Optoelectronics Technology Co., Ltd.; Boe Technology Group Co., Ltd.
- Inventors: Xuefeng Wang; Wenyu Li; Jinghua Miao; Xi Li; Longhui Wang; Zihe Liu; Lili Chen; Hao Zhang
- Web page: https://patentgrep.com/patent/US12223571B2

## CPC

- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 11/60: Creating or editing images; Combining images with text
- G09G 2340/04: Changes in size, position or resolution of an image
- G09G 2340/10: Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
- G09G 2340/12: Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A data transmission method includes: capturing, by a virtual reality host, a portion of an image to be transmitted in a preset area to obtain a first image, and compressing, by the virtual reality host, a portion of the image to be transmitted in a display area to obtain a second image, wherein the preset area is a portion of the display area (S101); transmitting, by the virtual reality host, the first image and the second image to a virtual reality apparatus in a certain order (S102); receiving the first image and the second image by the virtual reality apparatus (S103); stretching the second image by the virtual reality apparatus, and merging the first image with a stretched second image by the virtual reality apparatus to obtain an image to be displayed (S104); and displaying the image to be displayed by the virtual reality apparatus (S105).

## Claims

### Claim 1

A data transmission method for a virtual reality system, the data transmission method comprising:
capturing a portion of an image to be transmitted in a preset area by performing image sampling on the preset area of the image to be transmitted with a preset first resolution, a preset first field angle and a preset first refresh rate to obtain a first image, and compressing a portion of the image to be transmitted in a display area by performing image sampling on the display area of the image to be transmitted with a preset second resolution, a preset second field angle and a preset second refresh rate to obtain a second image, wherein the preset area is a portion of the display area;
transmitting the first image and the second image to a virtual reality apparatus in a certain order;
receiving the first image and the second image by the virtual reality apparatus;
stretching the second image by the virtual reality apparatus, and merging the first image with a stretched second image by the virtual reality apparatus to obtain an image to be displayed; and
displaying the image to be displayed by the virtual reality apparatus,
wherein the first resolution and the second resolution are equal to each other, the first field angle is less than the second field angle, and the first refresh rate is greater than or equal to the second refresh rate.

### Claim 2

A data transmission method for a virtual reality system, the data transmission method comprising:
receiving a first image and a second image;
stretching the second image, and merging the first image with a stretched second image to obtain an image to be displayed; and
displaying the image to be displayed;
the data transmission method further comprises, prior to the receiving the first image and the second image:
capturing a portion of an image to be transmitted in a preset area to obtain the first image, and compressing a portion of the image to be transmitted in a display area to obtain the second image, wherein the preset area is a portion of the display area; and
transmitting the first image and the second image to a virtual reality apparatus in a certain order; and
wherein the capturing the portion of the image to be transmitted in the preset area to obtain the first image and the compressing the image to be transmitted to obtain the second image comprise:
performing image sampling on the preset area of the image to be transmitted with a preset first resolution, a preset first field angle and a preset first refresh rate to obtain the first image; and
performing image sampling on the display area of the image to be transmitted with a preset second resolution, a preset second field angle and a preset second refresh rate to obtain the second image;
wherein the first resolution and the second resolution are equal to each other, the first field angle is less than the second field angle, and the first refresh rate is greater than or equal to the second refresh rate.

### Claim 3 (depends on 2)

The data transmission method according to claim 2, wherein the receiving the first image and the second image comprises:
receiving the first image and the second image, and distinguishing the first image and the second image from each other according to flag bit information; and
storing the first image in a first memory, and storing the second image in a second memory.

### Claim 4 (depends on 3)

The data transmission method according to claim 3, wherein the stretching the second image, and the merging the first image with the stretched second image to obtain the image to be displayed comprise:
obtaining the first image and the second image from the first memory and the second memory, respectively;
stretching the second image to make a resolution of the stretched second image equal to a display resolution of the virtual reality apparatus; and
merging the first image with the stretched second image to obtain the image to be displayed.

### Claim 5 (depends on 2)

The data transmission method according to claim 2, wherein the first refresh rate and the second refresh rate are determined as follows:
the first refresh rate of the first image and the second refresh rate of the second image are determined according to a refresh rate of the virtual reality apparatus and attitude information of the virtual reality apparatus.

### Claim 6 (depends on 2)

The data transmission method according to claim 2, wherein the transmitting the first image and the second image to the virtual reality apparatus in the certain order comprises:
arranging frames of the first image and the second image according to the first refresh rate and the second refresh rate to obtain an image sequence comprising the first image and the second image, and transmitting the image sequence to the virtual reality apparatus.

### Claim 7 (depends on 2)

The data transmission method according to claim 2, wherein the capturing the portion of the image to be transmitted in the preset area to obtain the first image, and the compressing the portion of the image to be transmitted in the display area to obtain the second image comprise:
adding flag bit information into the first image and the second image, respectively, wherein the flag information is configured to distinguish the first image and the second image from each other.

### Claim 8

A virtual reality apparatus, comprising:
a receiver configured to receive a first image and a second image transmitted from a virtual reality host;
an image merger configured to stretch the second image, and merge the first image with a stretched second image to obtain an image to be displayed; and
a display configured to display the image to be displayed,
wherein the virtual reality host comprises:
an image processor configured to capture a portion of an image to be transmitted in a preset area to obtain a first image, and compress a portion of the image to be transmitted in a display area to obtain a second image, wherein the preset area is a portion of the display area; and
a transmitter configured to transmit the first image and the second image to the virtual reality apparatus in a certain order; and
wherein the image processor is further configured to: perform image sampling on the preset area of the image to be transmitted with a preset first resolution, a preset first field angle and a preset first refresh rate to obtain the first image; and perform image sampling on the display area of the image to be transmitted with a preset second resolution, a preset second field angle and a preset second refresh rate to obtain the second image; wherein the first resolution and the second resolution are equal to each other, and the first refresh rate is greater than or equal to the second refresh rate.

### Claim 9 (depends on 8)

The virtual reality apparatus according to claim 8, wherein the receiver is further configured to: receive the first image and the second image, distinguish the first image and the second image from each other according to flag bit information; store the first image in a first memory; and store the second image in a second memory.

### Claim 10 (depends on 9)

The virtual reality apparatus according to claim 9, wherein the image merger is further configured to: obtain the first image and the second image from the first memory and the second memory, respectively; stretch the second image to make a resolution of the stretched second image equal to a display resolution of the virtual reality apparatus; and merge the first image with the stretched second image to obtain the image to be displayed.

### Claim 11 (depends on 8)

A virtual reality system, comprising: the virtual reality apparatus according to claim 8 and the virtual reality host.

### Claim 12 (depends on 8)

The virtual reality apparatus according to claim 8, wherein the virtual reality host is in communication connection with the virtual reality apparatus in a wired or wireless manner.

### Claim 13 (depends on 8)

The virtual reality apparatus according to claim 8, wherein the transmitter is further configured to: determine the first refresh rate of the first image and the second refresh rate of the second image according to a refresh rate of the virtual reality apparatus and attitude information of the virtual reality apparatus; arranging frames of the first image and the second image according to the first refresh rate and the second refresh rate to obtain an image sequence comprising the first image and the second image; and transmit the image sequence to the virtual reality apparatus.