# US 10,482,666 B2 · Display control methods and apparatuses

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,482,666 B2
- Document ID: US10482666B2
- Status: Granted
- Kind: B2
- Application number: 15/570,893
- Filed: 2016-05-04
- Published: 2018-10-11
- Granted: 2019-11-19
- Earliest claimed: 2015-05-04
- Assignees: Beijing Zhigu Rui Tuo Tech Co., Ltd
- Applicants: Beijing Zhigu Rui Tuo Tech Co., Ltd.
- Inventors: Liang Zhou; Lin Du
- Web page: https://patentgrep.com/patent/US10482666B2

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T)
- H04N 13/122: Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues (H04N13/128 takes precedence)
- G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)}
- G02B 2027/0118: {comprising devices for improving the contrast of the display / brillance control visibility}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G09G 3/003: {to produce spatial visual effects}
- G09G 2320/0626: for control of overall brightness
- G09G 2320/0666: for control of colour parameters, e.g. colour temperature
- G09G 2340/10: Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
- G09G 2340/14: Solving problems related to the presentation of information to be displayed
- H04N 2213/001: Constructional or mechanical details
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Embodiments of the present application disclose various display control methods and apparatuses. One of the methods comprises: determining at least local virtual enhancement information of an expected display environment of virtual content according to optical parameters of the virtual content; and controlling a display device to display the virtual content and the at least local virtual enhancement information of the expected display environment. The present application is favorable for enhancing a fusion display effect and improving user experience.

## Claims

### Claim 1

A display control method, comprising:
determining at least local virtual enhancement information of an expected display environment of virtual content according to optical parameters of the virtual content, wherein the expected display environment is a real display environment where the virtual content is expected to be displayed, and the virtual enhancement information is a virtual environment corresponding to the expected display environment and established according to the optical parameters of the virtual content; and
controlling a display device to display the virtual content and the at least local virtual enhancement information of the expected display environment.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining a first difference between the optical parameters of the virtual content and at least local optical parameters of the expected display environment;
wherein determining the at least local virtual enhancement information of the expected display environment of the virtual content according to the optical parameters of the virtual content comprises determining, responding to the first difference exceeding a preset permissible range, the at least local virtual enhancement information of the expected display environment of the virtual content according to the optical parameters of the virtual content.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
determining a second difference between the optical parameters of the virtual content and whole optical parameters of the expected display environment; and
controlling, responding to the second difference not exceeding the preset permissible range, the display device to display the virtual content.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining the at least local virtual enhancement information of the expected display environment of the virtual content comprises:
acquiring at least a local image of the expected display environment; and
adjusting optical parameters of the local image according to the optical parameters of the virtual content to generate an adjusted image, wherein the adjusted image is of the at least virtual enhancement information of the expected display environment of the virtual content.

### Claim 5 (depends on 4)

The method of claim 4, wherein controlling the display device to display the virtual content and the at least local virtual enhancement information of the expected display environment comprises:
acquiring at least local object depth information of the expected display environment; and
controlling the display device to display the virtual content and respective parts corresponding to objects of the expected display environment in the local image at corresponding depths, wherein the corresponding depths are determined according to the at least local object depth information.

### Claim 6 (depends on 1)

The method of claim 1, wherein the optical parameters comprise at least one of the following: brightness, color temperature, and saturation.

### Claim 7 (depends on 1)

The method of claim 1, wherein the display device comprises a near-to-eye display device.

### Claim 8 (depends on 7)

The method of claim 7, further comprising:
determining a difference between the optical parameters of the virtual content and whole optical parameters of the expected display environment; and
controlling, responding to the difference exceeding a preset permissible range, the near-to-eye display device to display the virtual content and whole virtual enhancement information of the expected display environment by a non-transmission display manner.

### Claim 9 (depends on 7)

The method of claim 7, further comprising:
determining a difference between the optical parameters of the virtual content and whole optical parameters of the expected display environment; and
controlling, responding to the difference not exceeding a preset permissible range, the near-to-eye display device to display the virtual content by a transmission display manner.

### Claim 10 (depends on 7)

The method of claim 7, further comprising:
determining a difference between the optical parameters of the virtual content and at least local optical parameters of the expected display environment; and
controlling, responding to the difference exceeding a preset permissible range, the near-to-eye display device to display the virtual content and the at least local virtual enhancement information of the expected display environment by a transmission display manner.

### Claim 11

A display control apparatus, comprising:
a virtual enhancement information determining module configured to determine at least local virtual enhancement information of an expected display environment of virtual content according to optical parameters of the virtual content, wherein the expected display environment is a real display environment where the virtual content is expected to be displayed, and the virtual enhancement information is a virtual environment corresponding to the expected display environment and established according to the optical parameters of the virtual content; and
a first display control module configured to control a display device to display the virtual content and the at least local virtual enhancement information of the expected display environment.

### Claim 12

A non-transitory computer-readable storage medium configured with instructions executable by one or more processors to cause the one or more processors to perform operations comprising:
determining at least local virtual enhancement information of an expected display environment of virtual content according to optical parameters of the virtual content, wherein the expected display environment is a real display environment where the virtual content is expected to be displayed, and the virtual enhancement information is a virtual environment corresponding to the expected display environment and established according to the optical parameters of the virtual content; and
controlling a display device to display the virtual content and the at least local virtual enhancement information of the expected display environment.

### Claim 13

A display control apparatus, comprising:
a processor; and
a memory configured to store instructions executable by the processor to cause the processor to perform operations including:
determining at least local virtual enhancement information of an expected display environment of virtual content according to optical parameters of the virtual content, wherein the expected display environment is a real display environment where the virtual content is expected to be displayed, and the virtual enhancement information is a virtual environment corresponding to the expected display environment and established according to the optical parameters of the virtual content; and
controlling a display device to display the virtual content and the at least local virtual enhancement information of the expected display environment.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the operations further comprises:
determining a first difference between the optical parameters of the virtual content and at least local optical parameters of the expected display environment; and
determining, responding to the difference exceeding a preset permissible environment, the at least local virtual enhancement information of the expected display environment of the virtual content according to optical parameters of the virtual content.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein the operations further comprises:
determining a second difference between the optical parameters of the virtual content and whole optical parameters of the expected display environment; and
controlling, responding to the second difference not exceeding the preset permissible range, the display device to display the virtual content.

### Claim 16 (depends on 13)

The apparatus of claim 13, wherein, the operations further comprises:
acquiring at least a local image of the expected display environment; and
adjusting optical parameters of the local image according to the optical parameters of the virtual content to generate an adjusted image, wherein the adjusted image is of at least local virtual enhancement information of the expected display environment of the virtual content.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the operations further comprises:
acquiring at least local object depth information of the expected display environment; and
controlling the display device to display the virtual content and respective parts corresponding to objects of the expected display environment in the local image at corresponding depths, wherein the corresponding depths are determined according to the at least local object depth information.

### Claim 18 (depends on 13)

The apparatus of claim 13, wherein the optical parameters comprise at least one of the following: brightness, color temperature, and saturation.

### Claim 19 (depends on 13)

The apparatus of claim 13, wherein the display device comprises a near-to-eye display device.

### Claim 20 (depends on 19)

The apparatus of claim 19, wherein the operations further comprises:
determining a difference between the optical parameters of the virtual content and whole optical parameters of the expected display environment; and
controlling, responding to the difference exceeding a preset permissible range, the near-to-eye display device to display the virtual content and whole virtual enhancement information of the expected display environment by a non-transmission display manner.

### Claim 21 (depends on 19)

The apparatus of claim 19, wherein the operations further comprises:
determining a difference between the optical parameters of the virtual content and whole optical parameters of the expected display environment; and
controlling, responding to the difference exceeding a preset permissible range, the near-to-eye display device to display the virtual content and the at least local virtual enhancement information of the expected display environment by a transmission display manner.

### Claim 22 (depends on 19)

The apparatus of claim 19, wherein the operations further comprises:
determining a difference between the optical parameters of the virtual content and at least local optical parameters of the expected display environment; and
controlling, responding to the difference not exceeding a preset permissible range, the near-to-eye display device to display the virtual content by a transmission display manner.