# US 2013/0293471 A1 · Push actuation of interface controls

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0293471 A1
- Document ID: US20130293471A1
- Status: Published application
- Kind: A1
- Application number: 13/931,565
- Filed: 2013-06-28
- Published: 2013-11-07
- Earliest claimed: 2011-02-16
- Assignees: Microsoft Corporation
- Applicants: Microsoft Corporation
- Inventors: Adam Jethro Langridge
- Web page: https://patentgrep.com/patent/US20130293471A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A computing system translates a world space position of a hand of a human target to a screen space cursor position of a user interface. When the cursor overlaps a button in the user interface, the computing system actuates the button in response to a movement of the hand in world space that changes the cursor position along a z-axis regardless of an initial z-axis position of the cursor.

## Claims

### Claim 1

A method of actuating a button in a user interface, comprising:
translating a world space position of a target to a screen space cursor position of the user interface such that movement of the target in world space causes corresponding movement of a cursor in screen space; and
when the cursor overlaps a button in the user interface, actuating the button responsive to a world space position of the target changing along a z-axis regardless of an initial z-axis position of the target in world space.

### Claim 2 (depends on 1)

The method of claim 1, wherein the target is a hand of a human user.

### Claim 3 (depends on 2)

The method of claim 2, wherein translating the world space position of the human hand to a screen space cursor position of the user interface includes modeling the human user from one or more images.

### Claim 4 (depends on 3)

The method of claim 3, wherein the one or more images include one or more depth images.

### Claim 5 (depends on 1)

The method of claim 1, wherein the z-axis is defined by an interaction zone that moves as a human user moves about in world space.

### Claim 6 (depends on 1)

The method of claim 1, wherein the button has an activation perimeter in an x-y plane, and wherein the cursor overlaps the button if an x-y coordinate of the cursor is within the activation perimeter of the button.

### Claim 7 (depends on 1)

The method of claim 1, wherein the button actuates responsive to a movement of the target in world space that changes the cursor position by a depth threshold along the z-axis.

### Claim 8 (depends on 7)

The method of claim 7, wherein the cursor has a cursor velocity, and wherein the depth threshold dynamically adjusts as a function of the cursor velocity.

### Claim 9 (depends on 8)

The method of claim 8, wherein the depth threshold is decreased as a normalized z-axis component of the cursor velocity increases.

### Claim 10 (depends on 8)

The method of claim 8, wherein the depth threshold is increased as a normalized z-axis component of the cursor velocity decreases.

### Claim 11

A method of actuating a button in a user interface, comprising:
translating a world space position of a target to a screen space cursor position of the user interface such that movement of the target in world space causes corresponding movement of a cursor in screen space; and
when the cursor overlaps a button in the user interface, actuating the button responsive to a movement of the target in world space that changes the screen space cursor position along a screen space z-axis regardless of an initial z-axis position of the cursor in screen space.

### Claim 12 (depends on 11)

The method of claim 11, wherein the target is a hand of a human user.

### Claim 13 (depends on 12)

The method of claim 12, wherein translating the world space position of the human hand to a screen space cursor position of the user interface includes modeling the human user from one or more images.

### Claim 14 (depends on 11)

The method of claim 11, wherein the z-axis is defined by an interaction zone that moves as a human user moves about in world space.

### Claim 15 (depends on 11)

The method of claim 11, wherein the button has an activation perimeter in an x-y plane, and wherein the cursor overlaps the button if an x-y coordinate of the cursor is within the activation perimeter of the button.

### Claim 16 (depends on 11)

The method of claim 11, wherein the button actuates responsive to a movement of the target in world space that changes the cursor position by a depth threshold along the z-axis.

### Claim 17 (depends on 16)

The method of claim 16, wherein the cursor has a cursor velocity, and wherein the depth threshold dynamically adjusts as a function of the cursor velocity.

### Claim 18 (depends on 17)

The method of claim 17, wherein the depth threshold is decreased as a normalized z-axis component of the cursor velocity increases.

### Claim 19 (depends on 17)

The method of claim 17, wherein the depth threshold is increased as a normalized z-axis component of the cursor velocity decreases.

### Claim 20

A method of actuating a button in a user interface, comprising:
translating a world space position of a hand to a screen space cursor position of the user interface such that movement of the hand in world space causes corresponding movement of a cursor in screen space; and
when the cursor overlaps a button in the user interface, actuating the button responsive to a world space position of the hand changing along a z-axis regardless of an initial z-axis position of the hand in world space, the z-axis defined by an interaction zone that moves as a human user moves about in world space.
