# US 2022/0277678 A1 · User device screen

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0277678 A1
- Document ID: US20220277678A1
- Status: Published application
- Kind: A1
- Application number: 17/680,769
- Filed: 2022-02-25
- Published: 2022-09-01
- Earliest claimed: 2021-03-01
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies Oy
- Inventors: Harry Cronin; Christopher WRIGHT; Phil CATTON; William SCHNABEL
- Web page: https://patentgrep.com/patent/US20220277678A1

## CPC

- G06F 3/0418: {for error correction or compensation, e.g. based on parallax, calibration or alignment}
- G09G 3/035: {for flexible display surfaces}
- G06F 1/1616: {with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G09G 2340/14: Solving problems related to the presentation of information to be displayed
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/144: the light being ambient light
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A method, apparatus and computer program is described comprising: determining a configuration of a reconfigurable screen of a user device; identifying potentially problematic sources of reflection from a scene around a user device based, at least in part, on the determined configuration; and compensating for said potentially problematic sources of reflection.

## Claims

### Claim at position 1

1-15. (canceled)

### Claim 16

An apparatus comprising:
at least one processor; and
at least one memory including computer program code,
the at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
determine a configuration of a reconfigurable screen of a user device;
based, at least in part, on the determined configuration, identify one or more potentially problematic sources of reflection from a scene around the user device; and
compensate for said one or more potentially problematic sources of reflection.

### Claim 17 (depends on 16)

An apparatus as claimed in claim 16, wherein the configuration of the reconfigurable screen comprises a fold angle of said screen.

### Claim 18 (depends on 16)

An apparatus as claimed in claim 16, wherein determining said one or more potentially problematic sources of reflection comprises:
based on the determined configuration, determining or retrieving geometric distortion information for the screen.

### Claim 19 (depends on 16)

An apparatus as claimed in claim 16, wherein the at least one memory and the instructions stored therein are configured to, with the at least one processor, further cause the apparatus to:
determine at least one of: one or more illumination sources that impact on the screen or objects that impact on the screen,
wherein identifying said one or more potentially problematic sources of reflection is further based, at least in part, on one or more respective locations of the determined at least one of: one or more illumination sources or objects.

### Claim 20 (depends on 19)

An apparatus as claimed in claim 19, the at least one memory and the instructions stored therein are configured to, with the at least one processor, further cause the apparatus to:
based, at least in part, on the one or more respective locations of the determined at least one of: one or more illumination sources or objects, identify one or more potentially problematic reflection areas of the screen.

### Claim 21 (depends on 19)

An apparatus as claimed in claim 19, wherein the apparatus further comprises one or more imaging devices configured to determine the at least one of: one or more illumination sources or objects.

### Claim 22 (depends on 19)

An apparatus as claimed in claim 19, wherein the at least one memory and the instructions stored therein are configured to, with the at least one processor, cause the apparatus to:
determine said at least one of: one or more illumination sources or objects by performing corneal reflection imaging.

### Claim 23 (depends on 19)

An apparatus as claimed in claim 19, wherein the at least one memory and the instructions stored therein are configured to, with the at least one processor, further cause the apparatus to:
determine at least one of an angle or a colour of illumination of the determined at least one of: one or more illumination sources or objects relative to the screen for use in at least one of identifying said one or more potentially problematic sources of reflection or for use in compensating for said one or more potentially problematic sources of reflection.

### Claim 24 (depends on 16)

An apparatus as claimed in claim 16, wherein compensation for said one or more potentially problematic sources of reflection comprises specular reflection correction.

### Claim 25 (depends on 16)

An apparatus as claimed in claim 16, wherein the at least one memory and the instructions stored therein are configured to, with the at least one processor, further cause the apparatus to:
determine a gaze direction of a viewer of the screen of the user device.

### Claim 26 (depends on 25)

An apparatus as claimed in claim 25, wherein identifying said one or more potentially problematic sources of reflection is further based, at least in part, on the determined gaze direction.

### Claim 27 (depends on 25)

An apparatus as claimed in claim 25, wherein the at least one memory and the instructions stored therein are configured to, with the at least one processor, further cause the apparatus to:
determine a compensation for said one or more potentially problematic sources of reflection based, at least in part, on the determined gaze direction.

### Claim 28

A user device comprising a reconfigurable screen and an apparatus, wherein the apparatus comprises:
at least one processor; and
at least one memory including computer program code,
the at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
determine a configuration of the reconfigurable screen of the user device;
based, at least in part, on the determined configuration, identify one or more potentially problematic sources of reflection from a scene around the user device; and
compensate for said one or more potentially problematic sources of reflection.

### Claim 29

A method comprising:
determining a configuration of a reconfigurable screen of a user device;
based, at least in part, on the determined configuration, identifying one or more potentially problematic sources of reflection from a scene around the user device; and
compensating for said one or more potentially problematic sources of reflection.

### Claim 30 (depends on 29)

A method as claimed in claim 29, wherein the configuration of the reconfigurable screen comprises a fold angle of said screen.

### Claim 31 (depends on 29)

A method as claimed in claim 29, wherein determining said one or more potentially problematic sources of reflection comprises:
based on the determined configuration, determining or retrieving geometric distortion information for the screen.

### Claim 32 (depends on 29)

A method as claimed in claim 29, further comprising:
determining at least one of: one or more illumination sources that impact on the screen or objects that impact on the screen,
wherein identifying said one or more potentially problematic sources of reflection is further based, at least in part, on one or more respective locations of the determined at least one of: one or more illumination sources or objects.

### Claim 33

A non-transitory computer readable medium comprising program instructions stored thereon for causing an apparatus to perform at least the following:
determine a configuration of a reconfigurable screen of a user device;
based, at least in part, on the determined configuration identify one or more potentially problematic sources of reflection from a scene around the user device; and
compensate for said one or more potentially problematic sources of reflection.

### Claim 34 (depends on 33)

The non-transitory computer readable medium of claim 33, wherein determining said one or more potentially problematic sources of reflection comprises:
based on the determined configuration, determining or retrieving geometric distortion information for the screen.

### Claim 35 (depends on 33)

The non-transitory computer readable medium of claim 33, wherein the program instructions are further configured to cause:
determining at least one of: one or more illumination sources that impact on the screen or objects that impact on the screen,
wherein identifying said one or more potentially problematic sources of reflection is further based, at least in part, on one or more respective locations of the determined at least one of: one or more illumination sources or objects.

### Claim 36

An apparatus comprising:
at least one processor; and
at least one memory including computer program code,
the at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
determine a configuration of a reconfigurable screen of a user device;
based, at least in part, on the determined configuration, identify one or more sources of reflection from a scene around the user device;
determine a gaze direction of a viewer of the screen of the user device;
based, at least in part, on the determined gaze direction of the viewer, determine a compensation for said one or more sources of reflection; and
perform the determined compensation for said one or more sources of reflection.

### Claim 37

An apparatus comprising:
at least one processor; and
at least one memory including computer program code,
the at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
determine a configuration of a reconfigurable screen of a user device;
based, at least in part, on the determined configuration, determine or retrieve geometric distortion information indicative of an angle from which a light source is reflected towards a viewer of the screen of the user device, from a scene around the user device; and
compensate for said light source.
