# US 2019/0377408 A1 · Dynamic adjustment of user interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0377408 A1
- Document ID: US20190377408A1
- Status: Published application
- Kind: A1
- Application number: 16/549,082
- Filed: 2019-08-23
- Published: 2019-12-12
- Earliest claimed: 2012-11-12
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Mark Schwesinger; Oscar Murillo; Emily Yang; Richard Bailey; Jay Kapur
- Web page: https://patentgrep.com/patent/US20190377408A1

## CPC

- G06F 3/012: {Head tracking input arrangements}
- A63F 13/21: characterised by their sensors, purposes or types
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 9/451: Execution arrangements for user interfaces
- G06T 7/73: using feature-based methods
- A63F 2300/1087: comprising photodetecting means, e.g. a camera
- A63F 2300/308: Details of the user interface
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Embodiments related to dynamically adjusting a user interface based upon depth information are disclosed. For example, one disclosed embodiment provides a method including receiving depth information of a physical space from a depth camera, locating a user within the physical space from the depth information, determining a distance between the user and a display device from the depth information, and adjusting one or more features of a user interface displayed on the display device based on the distance.

## Claims

### Claim 1

A method for adjusting a user interface display, comprising:
receiving depth information of a physical space from a depth camera;
locating a user within the physical space from the depth information;
determining from the depth information that a distance between the user and a display device has decreased; and
reducing a scale of an input zone based on the distance between the user and the display device having decreased, the input zone comprising a cross-sectional area less than a field of view of the depth camera.

### Claim 2 (depends on 1)

The method of claim 1, further comprising adjusting one or more features of a user interface displayed on the display device based at least on the distance having decreased.

### Claim 3 (depends on 2)

The method of claim 2, wherein adjusting the one or more features of the user interface comprises adjusting a number of features of the user interface displayed on the display device.

### Claim 4 (depends on 3)

The method of claim 3, wherein the number of features of the user interface displayed on the display device is increased based upon the distance between the user and the display device having decreased.

### Claim 5 (depends on 2)

The method of claim 2, wherein adjusting the one or more features of the user interface displayed on the display device based on the distance having decreased further comprises displaying the user interface with a first number of features when the distance is less than the threshold distance, and displaying the user interface with a second number of features when the distance is greater than the threshold distance.

### Claim 6 (depends on 5)

The method of claim 5, wherein the threshold distance is a first threshold distance, and further comprising continuing to display the user interface with the second number of features until the distance is below a second threshold distance, lower than the first threshold distance, and wherein once the distance is below the second threshold distance, displaying the user interface with the first number of features.

### Claim 7 (depends on 1)

The method of claim 1, further comprising determining that the distance between the user and the display device has increased, and increasing the scale of the input zone based on the distance having increased.

### Claim 8 (depends on 7)

The method of claim 7, further comprising receiving input from the user via gestures and/or voice commands after determining that the distance between the user and the display device has increased.

### Claim 9

On a computing device, a method for adjusting a user interface display, comprising:
receiving depth information of a physical space from a depth camera;
locating a user within the physical space from the depth information;
determining a distance between the user and a display device from the depth information;
when the user is a first distance from the display device, setting the input zone at a first, smaller scale; and
when the user is a second, greater distance from the display device, setting the input zone at a second, larger scale.

### Claim 10 (depends on 9)

The method of claim 9, further comprising, if the user is at the first distance, displaying a user interface on the display device with a first number of features and/or with features having a first size, and as the user moves from the first distance to the second distance, changing the user interface to display a second number of features that is different than the first number of features and/or to display features having a second size that is different than the first size.

### Claim 11 (depends on 10)

The method of claim 10, wherein the first number of features is greater than the second number of features, and the first size is smaller than the second size.

### Claim 12 (depends on 9)

The method of claim 9, further comprising, adjusting one or more features displayed by the display device upon detecting that the user moved across a threshold distance.

### Claim 13 (depends on 12)

The method of claim 12, wherein the threshold distance is a first threshold distance, and further comprising, as the user moves from the second distance toward the first distance and past the first threshold distance, maintaining the input zone of the user at the second size until a second threshold distance is crossed, and scaling the input zone of the user to the first size upon crossing the second threshold distance.

### Claim 14 (depends on 9)

The method of claim 9, further comprising when the user is the first distance from the display device, receiving input from the user via touch input on the display device.

### Claim 15 (depends on 9)

The method of claim 9, further comprising when the user is the second distance from the display device, receiving input from the user via gestures and/or voice commands.

### Claim 16

A computing device, comprising:
a logic subsystem; and
a storage subsystem holding instructions executable by the logic subsystem to:
receive depth information of a physical space from a depth camera;
locate a user within the physical space from the depth information;
determine from the depth information that a distance between the user and a display device has increased;
increase a scale of an input zone based on the distance between the user and the display device having increased, the input zone comprising a cross-sectional area less than a field of view of the depth camera.

### Claim 17 (depends on 16)

The computing device of claim 16, wherein the instructions are executable to increase the scale of the input zone of the user based on a size of the user determined from the depth information.

### Claim 18 (depends on 16)

The computing device of claim 16, wherein the instructions are further executable to determine that the distance between the user and the display device has decreased, and decrease the scale of the input zone based on the distance having decreased.

### Claim 19 (depends on 16)

The computing device of claim 16, wherein the instructions are further executable to adjust one or more features displayed by the display device upon detecting that the user moved across a threshold distance.

### Claim 20 (depends on 19)

The computing device of claim 19, wherein the instructions are executable to adjust the one or more features by adjusting a size and/or number of the one or more features displayed on the display device.
