# US 2015/0102995 A1 · Automatic view adjustment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0102995 A1
- Document ID: US20150102995A1
- Status: Published application
- Kind: A1
- Application number: 14/054,111
- Filed: 2013-10-15
- Published: 2015-04-16
- Earliest claimed: 2013-10-15
- Assignees: Microsoft Corporation
- Applicants: Microsoft Corporation
- Inventors: Guobin Shen; Liqun Li
- Web page: https://patentgrep.com/patent/US20150102995A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 1/3231: Monitoring the presence, absence or movement of users
- G06F 3/005: {Input arrangements through a video camera}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T)
- G09G 2340/04: Changes in size, position or resolution of an image
- G09G 2340/14: Solving problems related to the presentation of information to be displayed
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/144: the light being ambient light
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

A view adjustment system using information captured by one or more sensors on a client device determines a projection direction for content to be displayed on a display of the client device. Upon determining the projection direction, the view adjustment system transforms the content into a perspective view based on the determined projection direction and prompts the client device to present the content in the perspective view to a user. The view adjustment system may monitor changes in relative position and/or direction of the user with respect to the display, adjust the projection direction, and transform the content to reflect these changes.

## Claims

### Claim 1

A system comprising:
at least one processor;
memory operatively coupled to the at least one processor;
at least one sensor operatively coupled to the at least one processor;
a display operatively coupled to the at least one processor;
a detection module stored in the memory and executable by the at least one processor to:
detect a face of a user using the at least one sensor;
identify an eye of the user from the detected face; and
estimate an angle of view between the eye of the user and a surface of the display;
a transformation module stored in the memory and executable by the at least one processor to transform content for display by the display into a perspective view, the perspective view projecting the content into a plane perpendicular to a line of sight of the user based at least on the estimated angle of view; and
a display module stored in the memory and executable by the at least one processor to cause presentation of the content in the perspective view on the display.

### Claim 2 (depends on 1)

The system of claim 1, wherein the image sensor comprises at least one of a fisheye camera, a wide field-of-view camera, or an array of cameras.

### Claim 3 (depends on 1)

The system of claim 1, further comprising a determination module configured to determine whether to re-estimate the angle of view based at least on occurrence of a posture change or a device attitude change, and to trigger the detection module to re-estimate the angle of view based at least on the occurrence.

### Claim 4 (depends on 3)

The system of claim 3, wherein occurrence of the posture change or the device attitude change comprises at least one of:
the display being turned on;
the user using the display;
the user being within a predefined proximity of the display; or
a change in an amount of light incident on the display.

### Claim 5

A computer-implemented method comprising:
estimating an angle of view between a user and a display of a device; and
transforming content displayed on the display of the device into a perspective view based at least on the estimated angle of view.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, further comprising presenting the content in the perspective view to the user.

### Claim 7 (depends on 5)

The computer-implemented method of claim 5, wherein the transforming comprises projecting the content on a two-dimensional plane that is perpendicular to a line of sight of the user that is determined based on the estimated angle of view.

### Claim 8 (depends on 5)

The computer-implemented method of claim 5, wherein the device comprises a computing device, a mobile device, or a display device.

### Claim 9 (depends on 6)

The computer-implemented method of claim 6, further comprising monitoring the angle of view between the user and the display of the device.

### Claim 10 (depends on 5)

The computer-implemented method of claim 5, further comprising:
detecting a change in the angle of view between the user and the display of the device; and
adjusting the perspective view based on the change in the angle of view.

### Claim 11 (depends on 5)

The computer-implemented method of claim 5, further comprising determining that a condition for estimating the angle of view is satisfied.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, wherein the condition comprises at least one of:
the display being turned on;
the user using the device;
the user being within a predefined proximity of the device; or
a change in an amount of light incident on the device.

### Claim 13 (depends on 5)

The computer-implemented method of claim 5, wherein the estimating comprises:
detecting, by a sensor, a face of the user;
identifying an eye of the user from the detected face;
determining a line of sight from the eye of the user to the display of the device; and
determining the angle of view based on the estimated line of sight.

### Claim 14 (depends on 13)

The computer-implemented method of claim 13, wherein the sensor comprises at least one of a fisheye camera, a wide field-of-view camera, or an array of cameras.

### Claim 15 (depends on 5)

The computer-implemented method of claim 5, wherein the angle of view corresponds to an angle between a line of sight from the user and a plane parallel to a surface of the display of the device.

### Claim 16

One or more computer-readable media storing executable instructions that, when executed by one or more processors, cause the one or more processors to perform acts comprising:
receiving input from one or more sensors;
determining a line of sight from a user to a display based on the input; and
transforming content displayed on the display into a perspective view that projects the content into a plane substantially perpendicular to the line of sight from the user.

### Claim 17 (depends on 16)

The one or more computer-readable media of claim 16, the acts further comprising providing the content in the perspective view for presentation to the user.

### Claim 18 (depends on 16)

The one or more computer-readable media of claim 16, the acts further comprising:
detecting a change in the line of sight from the user to the display;
transforming the content displayed on the display to a new perspective view; and
presenting the content in the new perspective view to the user.

### Claim 19 (depends on 16)

The one or more computer-readable media of claim 16, the acts further comprising determining that a condition for determining the line of sight is satisfied.

### Claim 20 (depends on 19)

The one or more computer-readable media of claim 19, wherein the condition comprises at least one of:
the display being turned on;
the user using a device of the display;
the user being within a predefined proximity of the display; or
a change in an amount of light incident on the device of the display.
