# US 2021/0341998 A1 · Gaze-point determining method, contrast adjusting method, and contrast adjusting apparatus, virtual reality device and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0341998 A1
- Document ID: US20210341998A1
- Status: Published application
- Kind: A1
- Application number: 16/335,952
- Filed: 2018-09-19
- Published: 2021-11-04
- Earliest claimed: 2018-01-12
- Assignees: Boe Technology Group Co., Ltd.
- Applicants: Boe Technology Group Co., Ltd.
- Inventors: Gaoming SUN
- Web page: https://patentgrep.com/patent/US20210341998A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 1/3265: {Power saving in display device}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 5/94: based on local image properties, e.g. for local contrast enhancement
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 40/18: Eye characteristics, e.g. of the iris
- G06V 40/193: {Preprocessing; Feature extraction}
- G06T 2207/20012: Locally adaptive
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

A gaze-point determining method, a contrast adjusting method and a contrast adjusting apparatus for a virtual reality device, a virtual reality device and a storage medium. The contrast adjusting method includes: determining a coordinate of a gaze point in a display region viewed by a user; determining a gaze region of the user based on the coordinate of the gaze point; and adjusting brightness of the gaze region.

## Claims

### Claim 1

A gaze-point determining method, comprising,
acquiring a center position coordinate of a pupil of a user; and
determining a coordinate of a gaze point in a display region viewed by the user by means of mapping, based on the center position coordinate of the pupil.

### Claim 2 (depends on 1)

The gaze-point determining method according to claim 1, wherein the coordinate of the gaze point is obtained by following expressions:
{
X
G
=
a
0
+
a
1
·
x
+
a
2
·
y
+
a
3
·
x
·
y
+
a
4
·
x
2
+
a
5
·
y
2
+
a
6
·
x
2
·
y
2
Y
G
=
b
0
+
b
1
·
x
+
b
2
·
y
+
b
3
·
x
·
y
+
b
4
·
x
2
+
b
5
·
y
2
+
b
6
·
x
2
·
y
2
where XG is a horizontal coordinate of the gaze point and YG is a vertical coordinate of the gaze point, x is a horizontal coordinate of the center position of the pupil and y is a vertical coordinate of the center position of the pupil, and a0 to a6 and b0 to b6 are mapping parameters.

### Claim 3 (depends on 2)

The gaze-point determining method according to claim 2, wherein the mapping parameters are determined based on a coordinate of a preset calibration point in the display region and a plurality of pre-acquired coordinates of center positions of the pupil.

### Claim 4 (depends on 1)

The gaze-point determining method according to claim 1, wherein the acquiring the center position coordinate of the pupil of the user comprises:
obtaining image information of an eyeball of the user and image information of a periphery of the eyeball;
extracting a feature of the image information of the eyeball of the user and a feature of the image information of the periphery of the eyeball to obtain an image of the pupil of the user; and
determining a center position coordinate of the image of the pupil of the user.

### Claim 5

A contrast adjusting method for a virtual reality device, comprising
determining a coordinate of a gaze point in a display region viewed by a user through a gaze-point determining method, wherein the gaze-point determining method comprises: acquiring a center position coordinate of a pupil of a user; and determining a coordinate of a gaze point in a display region viewed by the user by means of mapping, based on the center position coordinate of the pupil;
determining a gaze region of the user based on the coordinate of the gaze point; and
adjusting brightness of the gaze region.

### Claim 6 (depends on 5)

The contrast adjusting method according to claim 5, wherein the gaze region of the user is determined to be a region, the region is centered on the gaze point, a length of the region is in a range of 15% to 45% of a length of the display region viewed by the user and a width of the region is in a range of 15% to 45% of a width of the display region viewed by the user.

### Claim 7 (depends on 5)

The contrast adjusting method according to claim 5, wherein the display region viewed by the user further comprises a non-gaze region located outside the gaze region, and
the contrast adjusting method further comprises: adjusting brightness of the non-gaze region.

### Claim 8 (depends on 7)

The contrast adjusting method according to claim 7, wherein the brightness of the non-gaze region is adjusted based on a distance from the non-gaze region to the gaze region.

### Claim 9 (depends on 7)

The contrast adjusting method according to claim 7, wherein the adjusting brightness of the gaze region is a brightness increasing operation, and the brightness increasing operation comprises:
detecting an average brightness value of the display region viewed by the user and an average brightness value corresponding to a predetermined power consumption; and
increasing the brightness of the gaze region, in a case where the average brightness value of the display region viewed by the user is less than the average brightness value corresponding to the predetermined power consumption.

### Claim 10 (depends on 9)

The contrast adjusting method according to claim 9, wherein the brightness increasing operation further comprises:
reducing the brightness of the non-gaze region, in a case where the average brightness value of the display region viewed by the user is greater than or equal to the average brightness value corresponding to the predetermined power consumption.

### Claim 11 (depends on 10)

The contrast adjusting method according to claim 10, wherein,
the increasing the brightness of the gaze region comprises: multiplying a pixel value of the gaze region by an average brightness ratio;
the reducing the brightness of the non-gaze region comprises: multiplying a pixel value of the non-gaze region by the average brightness ratio,
the average brightness ratio is expressed as follows:
L
=
Ave
⁢
⁢
2
Ave
⁢
⁢
1
where L denotes the average brightness ratio, Ave1 denotes the average brightness value of the display region viewed by the user, and Ave2 denotes the average brightness value corresponding to the predetermined power consumption.

### Claim 12 (depends on 5)

A contrast adjusting apparatus, comprising:
a processor;
a memory;
one or more computer program modules, stored in the memory and configured to be executed by the processor, and comprising instructions for implementing the contrast adjusting method according to claim 5.

### Claim 13

A contrast adjusting apparatus, comprising a gaze region obtaining unit and a brightness adjustment unit, wherein,
the gaze region obtaining unit is configured to determine a coordinate of a gaze point in a display region viewed by a user according to a center position coordinate of a pupil of a user, and to determine a gaze region of the user according to the coordinate of the gaze point; and
the brightness adjustment unit is configured to adjust brightness of the gaze region.

### Claim 14 (depends on 13)

The contrast adjusting apparatus according to claim 13, wherein the display region viewed by the user further comprises a non-gaze region located outside the gaze region, and the brightness adjustment unit is further configured to adjust brightness of the non-gaze region.

### Claim 15 (depends on 14)

The contrast adjusting apparatus according to claim 14, wherein the brightness adjustment unit comprises a brightness increasing sub-unit configured to increase the brightness of the gaze region in a case where an average brightness value of an display region viewed by the user is less than an average brightness value corresponding to a predetermined power consumption, or to reduce the brightness of the non-gaze region in a case where the average brightness value of the display region viewed by the user is greater than or equal to the average brightness value corresponding to the predetermined power consumption.

### Claim 16 (depends on 13)

The contrast adjusting apparatus according to claim 13, wherein the gaze region obtaining unit further comprises:
a center position coordinate obtaining sub-unit, configured to obtain the center position coordinate of the pupil of the user; and
a gaze point coordinate obtaining sub-unit, configured to determine the coordinate of the gaze point in the display region viewed by the user by means of mapping, according to the center position coordinate of the pupil.

### Claim 17 (depends on 16)

The contrast adjusting apparatus according to claim 16, further comprising a pupil center position obtaining unit,
wherein the pupil center position obtaining unit is configured to: obtain image information of an eyeball of the user and image information of a periphery of the eyeball, extract a feature of the image information of the eyeball of the user and a feature of the image information of the periphery of the eyeball to obtain an image of the pupil of the user, and determine a center position coordinate of the image of the pupil of the user.

### Claim 18 (depends on 12)

A virtual reality device, comprising the contrast adjusting apparatus according to claim 12.

### Claim 19 (depends on 18)

The virtual reality device according to claim 18, further comprising an image acquisition apparatus, wherein the image acquisition apparatus is configured to obtain an image of the pupil of the user.

### Claim 20 (depends on 1)

A storage medium, non-temporarily storing computer-readable instructions, which when executed by a computer, execute the gaze-point determining method according to claim 1.