# US 2018/0321740 A1 · Display distortion for alignment with a user gaze direction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0321740 A1
- Document ID: US20180321740A1
- Status: Published application
- Kind: A1
- Application number: 15/586,426
- Filed: 2017-05-04
- Published: 2018-11-08
- Earliest claimed: 2017-05-04
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Donald L. Bryson; Eric V. Kline; Sarbajit K. Rakshit
- Web page: https://patentgrep.com/patent/US20180321740A1

## CPC

- G09G 3/035: {for flexible display surfaces}
- G06F 1/1652: {the display being flexible, e.g. mimicking a sheet of paper, or rollable}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- H04M 1/0268: {including a flexible display panel}
- H10N 30/204: {using bending displacement, e.g. unimorph, bimorph or multimorph cantilever or membrane benders}
- G06F 1/1684: {Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 21/00: Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- G09F 9/301: {flexible foldable or roll-able electronic displays, e.g. thin LCD, OLED}
- G09F 9/372: {the positions of the elements being controlled by the application of an electric field}
- G09G 3/2003: {Display of colours (specific for liquid crystal displays G09G3/3607)}
- G09G 3/2092: {Details of a display terminals using a flat panel, the details relating to the control arrangement of the display terminal and to the interfaces thereto (suitable for both CRT and flat panel G09G5/003; specific for a CRT G09G1/165)}
- G09G 2320/028: by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction
- G09G 2320/0613: The adjustment depending on the type of the information to be displayed
- G09G 2320/068: for control of viewing angle adjustment
- G09G 2320/08: Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal
- G09G 2340/0464: Positioning
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/144: the light being ambient light
- H04M 2250/52: including functional features of a camera
- H04N 5/64: Constructional details of receivers, e.g. cabinets or dust covers (furniture aspects {of television cabinets} A47B81/06)
- H10N 30/802: {Circuitry or processes for operating piezoelectric or electrostrictive devices not otherwise provided for, e.g. drive circuits}
- H10N 30/857: Macromolecular compositions
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H10N: ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- G09F: DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems, methods, and computer-readable media are disclosed for distorting a display coupled to a user device to bring the display into alignment with a gaze direction of a user of the user device. In certain scenarios, a user's gaze direction may not be aligned with a display of the user device. In such example scenarios, a user device determines a gaze direction of a user using, for example, camera means. When an event occurs, the user device determines one or more distortion elements to activate based at least in part on the gaze direction of the user. The user device then activates the distortion element(s) to cause the display of the device to distort to a position in which it is aligned with the gaze direction of the user. The distortion element(s) may be formed of an electroactive polymer configured to deform upon application of an electric field.

## Claims

### Claim 1

A computer-implemented method for distorting a display coupled to a user device, the method comprising:
identifying an event;
determining a gaze direction of a user of the user device;
determining one or more distortion elements to activate based at least in part on the gaze direction of the user;
activating the one or more distortion elements to cause the display to distort and align with the gaze direction of the user.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising determining one or more characteristics of content displayed on the display, wherein determining the one or more distortion elements comprises determining the one or more distortion elements further based at least in part on the one or more characteristics of the content.

### Claim 3 (depends on 1)

The computer-implemented of claim 1, further comprising determining that the event satisfies one or more criteria for distorting the display.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the event is a device-based event, and wherein determining that the event satisfies the one or more criteria for distorting the display comprises determining that the gaze direction of the user is within a predetermined range of potential gaze directions within a predetermined period of time from occurrence of the event.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein activating the one or more distortion elements comprises causing an electric field to be applied to one or more electroactive polymer (EAP) portions to cause the one or more EAP portions to deform.

### Claim 6 (depends on 4)

The computer-implemented method of claim 4, wherein the one or more (EAP) portions comprise a plurality of (EAP) portions, and wherein at least two of the (EAP) portions overlap orthogonally or non-orthogonally.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the event comprises one of a device-based event or a change in the gaze direction of the user.

### Claim 8

A device, comprising:
at least one memory storing computer-executable instructions; and
at least one processor configured to access the at least one memory and execute the computer-executable instructions to:
identify an event;
determine a gaze direction of a user of the device;
determine one or more distortion elements to activate based at least in part on the gaze direction of the user;
activate the one or more distortion elements to cause a display coupled to the device to distort and align with the gaze direction of the user.

### Claim 9 (depends on 8)

The device of claim 8, wherein the at least one processor is further configured to execute the computer-executable instructions to determine one or more characteristics of content displayed on the display, and wherein the at least one processor executes the computer-executable instructions to determine the one or more distortion elements further based at least in part on the one or more content characteristics.

### Claim 10 (depends on 8)

The device of claim 8, wherein the at least one processor is further configured to execute the computer-executable instructions to determine that the event satisfies one or more criteria for distorting the display.

### Claim 11 (depends on 10)

The device of claim 10, wherein the event is a device-based event, and wherein the at least one processor is configured to determine that the event satisfies the one or more criteria for distorting the display by executing the computer-executable instructions to determine that the gaze direction of the user is within a predetermined range of potential gaze directions within a predetermined period of time from occurrence of the event.

### Claim 12 (depends on 8)

The device of claim 8, wherein the at least one processor is configured to activate the one or more distortion elements by executing the computer-executable instructions to cause an electric field to be applied to one or more electroactive polymer portions to cause the one or more (EAP) portions to deform.

### Claim 13 (depends on 12)

The device of claim 12, wherein the one or more (EAP) portions comprise a plurality of (EAP) portions, and wherein at least two of the (EAP) portions overlap orthogonally or non-orthogonally.

### Claim 14 (depends on 8)

The device of claim 8, wherein the event comprises one of a device-based event or a change in the gaze direction of the user.

### Claim 15

A computer program product for distorting a display coupled to a user device, the computer program product comprising a storage medium readable by a processing circuit, the storage medium storing instructions executable by the processing circuit to cause a method to be performed, the method comprising:
identifying an event;
determining a gaze direction of a user of the user device;
determining one or more distortion elements to activate based at least in part on the gaze direction of the user;
activating the one or more distortion elements to cause the display to distort and align with the gaze direction of the user.

### Claim 16 (depends on 15)

The computer program product of claim 15, the method further comprising determining one or more characteristics of content displayed on the display, wherein determining the one or more distortion elements comprises determining the one or more distortion elements further based at least in part on the one or more characteristics of the content.

### Claim 17 (depends on 15)

The computer program product of claim 15, further comprising determining that the event satisfies one or more criteria for distorting the display.

### Claim 18 (depends on 17)

The computer program product of claim 17, wherein the event is a device-based event, and wherein determining that the event satisfies the one or more criteria for distorting the display comprises determining that the gaze direction of the user is within a predetermined range of potential gaze directions within a predetermined period of time from occurrence of the event.

### Claim 19 (depends on 15)

The computer program product of claim 15, wherein activating the one or more distortion elements comprises causing an electric field to be applied to one or more electroactive polymer portions to cause the one or more (EAP) portions to deform.

### Claim 20 (depends on 19)

The computer program product of claim 19, wherein the one or more (EAP) portions comprise a plurality of (EAP) portions, and wherein at least two of the (EAP) portions overlap orthogonally or non-orthogonally.
