# US 12,181,680 B1 · Adaptive shading adjustment in optical apparatuses

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,181,680 B1
- Document ID: US12181680B1
- Status: Granted
- Kind: B1
- Application number: 18/468,945
- Filed: 2023-09-18
- Granted: 2024-12-31
- Earliest claimed: 2023-09-18
- Assignees: Pixieray Oy
- Applicants: Pixieray Oy
- Inventors: Rebecca Qing Melakari
- Web page: https://patentgrep.com/patent/US12181680B1

## CPC

- G02B 27/0172: {characterised by optical features}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02C 7/101: {having an electro-optical light valve (electro-optical elements per se G02F)}
- G02C 11/10: {Electronic devices other than hearing aids}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G09G 3/20: for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix {no fixed position being assigned to or needed to be assigned to the individual characters or partial characters}
- G02B 2027/0118: {comprising devices for improving the contrast of the display / brillance control visibility}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02C 7/12: Polarisers
- G09G 2320/0626: for control of overall brightness
- G09G 2370/00: Aspects of data communication
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02C: SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES (trial frames for testing the eyes A61B3/04; goggles or eyeshields not having the same features as spectacles A61F9/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Disclosed is an optical apparatus with an optical element per eye; a light-control element arranged on an optical path of light passing through the optical element; light sensor(s); and processor(s) configured to: process tracking data to determine at least one of: a gaze position, a gaze direction, a gaze velocity, a gaze acceleration, per eye of a user; determine a current visual activity of the user; determine an ambient light intensity in an environment; determine a shading intensity to be used for the optical element, based on the ambient light intensity and the current visual activity of the user; and control the light-control element to apply the shading intensity to the optical element.

## Claims

### Claim 1

An optical apparatus comprising:
an optical element per eye;
a light-control element arranged on an optical path of light passing through the optical element;
at least one light sensor; and
at least one processor configured to:
process tracking data, collected by at least one of: an eye-tracking means of the optical apparatus, an eye-tracking means of an external device, a face-tracking means of the external device, to determine at least one of: a gaze position, a gaze direction, a gaze velocity, a gaze acceleration, per eye of a user;
determine a current visual task in which the user is engaged selected from at least one of: reading text, focusing on an object or a part of the object, casual glancing, distance viewing, viewing an image or a video on a display;
process sensor data, collected by the at least one light sensor, to determine an ambient light intensity in an environment where the optical apparatus is being used;
determine a shading intensity of a level of tint or darkness to be used for the optical element, based on the ambient light intensity and the current visual task of the user; and
control the light-control element to apply the shading intensity to the optical element.

### Claim 2 (depends on 1)

The optical apparatus of claim 1, wherein a plurality of output light intensities are associated with respective ones of a plurality of different visual activities, and wherein the at least one processor is further configured to:
select an output light intensity, from amongst the plurality of output light intensities, based on the current visual task of the user; and
determine the shading intensity, further based on the output light intensity.

### Claim 3 (depends on 1)

The optical apparatus of claim 1, wherein the current visual task is determined to be a reading activity, when at least one of an angle of convergence of gaze directions of the user's eyes is greater than a predefined angle and the gaze velocity and/or the gaze acceleration of the eye are indicative of an intermix of saccades and fixations along a given direction and another direction opposite to the given direction.

### Claim 4 (depends on 1)

The optical apparatus of claim 1, wherein the current visual task is determined to be a display-viewing activity, when the user's face is oriented towards the display and optionally when a distance of the user's face from the display is smaller than a predefined threshold distance.

### Claim 5 (depends on 1)

The optical apparatus of claim 1, wherein the at least one processor is further configured to:
process the sensor data, collected by the at least one light sensor, to determine direct light intensities along gaze directions of the user's eyes; and
determine the shading intensity, further based on the direct light intensities.

### Claim 6 (depends on 5)

The optical apparatus of claim 5, wherein the at least one processor is further configured to:
detect whether the direct light intensities exceed a predefined direct light intensity threshold for the current visual task; and
when it is detected that the direct light intensities exceed the predefined direct light intensity threshold, determine that the user is using the display of the external device during the current visual task.

### Claim 7 (depends on 6)

The optical apparatus of claim 6, wherein the optical apparatus is communicably coupled to the external device or a server with which the external device is communicably coupled, and wherein the at least one processor is further configured to:
generate a control signal to adjust a brightness level of the display of the external device, based on at least one of: the direct light intensities, the ambient light intensity, the predefined direct light intensity threshold; and
transmit the control signal to the external device,
wherein a processor of the external device is configured to adjust the brightness level of the display of the external device according to the control signal.

### Claim 8 (depends on 1)

The optical apparatus of claim 1, wherein the light-control element is implemented as at least one of: an electrochromic element, a liquid crystal element, at least two polarizers.

### Claim 9

A method implemented by an optical apparatus comprising an optical element per eye, a light-control element arranged on an optical path of light passing through the optical element, at least one light sensor, and at least one processor, wherein the method comprises:
processing tracking data, collected by at least one of: an eye-tracking means of the optical apparatus, an eye-tracking means of an external device, a face-tracking means of the external device, for determining at least one of: a gaze position, a gaze direction, a gaze velocity, a gaze acceleration, per eye of a user;
determining a current visual task in which the user is engaged selected from at least one of: reading text, focusing on an object or a part of the object, casual glancing, distance viewing, viewing an image or a video on a display;
processing sensor data, collected by the at least one light sensor, for determining an ambient light intensity in an environment where the optical apparatus is being used;
determining a shading intensity of a level of tint or darkness to be used for the optical element, based on the ambient light intensity and the current visual task of the user; and
controlling the light-control element for applying the shading intensity to the optical element.

### Claim 10 (depends on 9)

The method of claim 9, wherein a plurality of output light intensities are associated with respective ones of a plurality of different visual activities, and wherein the method further comprises:
selecting an output light intensity, from amongst the plurality of output light intensities, based on the current visual task of the user; and
determining the shading intensity, further based on the output light intensity.

### Claim 11 (depends on 9)

The method of claim 9, wherein the current visual task is determined to be a reading activity, when at least one of an angle of convergence of gaze directions of the user's eyes is greater than a predefined angle and the gaze velocity and/or the gaze acceleration of the eye are indicative of an intermix of saccades and fixations along a given direction and another direction opposite to the given direction.

### Claim 12 (depends on 9)

The method of claim 9, wherein the current visual task is determined to be a display-viewing activity, when the user's face is oriented towards the display and optionally when the distance of the user's face from the display is smaller than a predefined threshold distance.

### Claim 13 (depends on 9)

The method of claim 9, further comprising:
processing the sensor data, collected by the at least one light sensor, for determining direct light intensities along gaze directions of the user's eyes; and
determining the shading intensity, further based on the direct light intensities.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
detecting whether the direct light intensities exceed a predefined direct light intensity threshold for the current visual task; and
when it is detected that the direct light intensities exceed the predefined direct light intensity threshold, determining that the user is using the display of the external device during the current visual task.

### Claim 15 (depends on 14)

The method of claim 14, wherein the optical apparatus is communicably coupled to the external device or a server with which the external device is communicably coupled, and wherein the method further comprises:
generating a control signal for adjusting a brightness level of the display of the external device, based on at least one of: the direct light intensities, the ambient light intensity, the predefined direct light intensity threshold; and
transmitting the control signal to the external device,
wherein a processor of the external device is configured to adjust the brightness level of the display of the external device according to the control signal.

### Claim 16 (depends on 9)

The method of claim 9, wherein the light-control element is implemented as at least one of: an electrochromic element, a liquid crystal element, at least two polarizers.
