# US 2010/0306710 A1 · Living cursor control mechanics

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0306710 A1
- Document ID: US20100306710A1
- Status: Published application
- Kind: A1
- Application number: 12/474,347
- Filed: 2009-05-29
- Published: 2010-12-02
- Earliest claimed: 2009-05-29
- Assignees: Microsoft Corporation
- Inventors: Rudy Jacobus Poot
- Web page: https://patentgrep.com/patent/US20100306710A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Disclosed herein are systems and methods for controlling a cursor. A user may control a cursor displayed by a computing environment such as a game console, a computer, or the like by performing one or more gestures. An activity of a cursor on an audiovisual display may be controlled based on one or more gestures of the user, a profile of the user, other inputs, or combinations thereof. Further, an appearance of a cursor on an audiovisual display may also be controlled based on one or more gestures of the user, a profile of the user, other inputs, or combinations thereof. User gestures may be detected by, for example, a capture device. For example, the capture device may capture a depth image of a scene including a user.

## Claims

### Claim 1

A method for controlling a cursor, the method comprising:
determining a profile of a person;
detecting a gesture of the person;
determining, based on at least one of the profile and the gesture of the person, at least one of an appearance for a cursor and an activity for the cursor; and
displaying the cursor according to the at least one of the appearance and the activity for the cursor.

### Claim 2 (depends on 1)

The method of claim 1 wherein determining a profile of a person further comprises determining one or more of a person's size, facial features, voice, playing history, gesture input history, age, and typical mode of play.

### Claim 3 (depends on 1)

The method of claim 1 wherein detecting a gesture of the person further comprises detecting movement of an appendage of the person.

### Claim 4 (depends on 1)

The method of claim 1 wherein detecting a gesture of the person further comprises tracking hand movements of the person, and wherein displaying the cursor comprises moving the cursor along a vector based on the hand movement of the person,
wherein the method further comprises:
determining whether the cursor's vector meets a predetermined vector with respect to a display object; and
causing a physics-based reaction of the cursor with respect to the display object if the cursor's vector meets the predetermined vector with respect to the display object.

### Claim 5 (depends on 1)

The method of claim 1 wherein detecting a gesture of the person further comprises determining whether one of the person's hand moving closer to a capture device and the person's hand moving away from the capture device, and wherein, if the one of the person's hand moves closer to a capture device and the person's hand moves away from the capture device, displaying the cursor to appear to be moving in a Z-direction.

### Claim 6 (depends on 1)

The method of claim 1 wherein determining an appearance for the cursor comprises determining one of the cursor's color, shape, size, and graphics.

### Claim 7 (depends on 1)

The method of claim 1 wherein determining an activity of the cursor further comprises determining whether the cursor is within a predetermined distance from a display object; and
the method further comprising selecting the display object with the cursor if the cursor is within the predetermined distance from the display object.

### Claim 8 (depends on 1)

The method of claim 1 wherein determining an activity of the cursor further comprises determining whether a cursor's vector meets a predetermined vector with respect to a display object; and
the method further comprising causing a physics-based reaction of the cursor with respect to the display object if the cursor's vector meets the predetermined vector with respect to the display object.

### Claim 9 (depends on 1)

The method of claim 1 further comprising receiving an audio input, and wherein determining the at least one of an appearance for the cursor and the activity for the cursor further comprises determining the at least one of an appearance for the cursor and the activity for the cursor based on the audio input.

### Claim 10

A computer readable medium having stored thereon computer executable instructions for controlling a cursor, comprising:
determining a profile of a person;
detecting a gesture of the person;
determining, based on at least one of the profile and the gesture of the person, at least one of an appearance for a cursor and an activity for the cursor; and
displaying the cursor according to the at least one of the appearance and the activity for the cursor.

### Claim 11 (depends on 10)

The computer readable medium of claim 10 wherein determining a profile of a person further comprises determining one or more of a person's size, facial features, voice, playing history, gesture input history, age, and typical mode of play.

### Claim 12 (depends on 10)

The computer readable medium of claim 10 wherein detecting a gesture of the person further comprises detecting movement of an appendage of the person.

### Claim 13 (depends on 10)

The computer readable medium of claim 10 wherein detecting a gesture of the person further comprises tracking hand movements of the person, and wherein displaying the cursor comprises moving the cursor along a vector based on the hand movement of the person,
wherein the computer executable instructions further comprise:
determining whether the cursor's vector meets a predetermined vector with respect to a display object; and
causing a physics-based reaction of the cursor with respect to the display object if the cursor's vector meets the predetermined vector with respect to the display object.

### Claim 14 (depends on 10)

The computer readable medium of claim 10 wherein detecting a gesture of the person further comprises determining whether one of the person's hand moving closer to a capture device and the person's hand moving away from the capture device, and wherein, if the one of the person's hand moves closer to a capture device and the person's hand moves away from the capture device, displaying the cursor to appear to be moving in a Z-direction.

### Claim 15

A system for controlling a cursor, the system comprising:
a computing device for:
determining a profile of a person;
detecting a gesture of the person;
determining, based on at least one of the profile and the gesture of the person, at least one of an appearance for a cursor and an activity for the cursor; and
a display for displaying the cursor according to the at least one of the appearance and the activity for the cursor.

### Claim 16 (depends on 15)

The system of claim 15 wherein determining a profile of a person further comprises determining one or more of a person's size, facial features, voice, playing history, gesture input history, age, and typical mode of play.

### Claim 17 (depends on 15)

The system of claim 15 wherein detecting a gesture of the person further comprises detecting movement of an appendage of the person.

### Claim 18 (depends on 15)

The system of claim 15 wherein detecting a gesture of the person further comprises tracking hand movements of the person, and wherein displaying the cursor comprises moving the cursor along a vector based on the hand movement of the person,
wherein the computing device is configured to determine whether the cursor's vector meets a predetermined vector with respect to a display object, and configured to the cause a physics-based reaction of the cursor with respect to the display object if the cursor's vector meets the predetermined vector with respect to the display object.

### Claim 19 (depends on 15)

The system of claim 15 wherein detecting a gesture of the person further comprises determining whether one of the person's hand moving closer to a capture device and the person's hand moving away from the capture device, and wherein, if the one of the person's hand moves closer to a capture device and the person's hand moves away from the capture device, displaying the cursor to appear to be moving in a Z-direction.

### Claim 20 (depends on 15)

The system of claim 15 wherein determining an appearance for the cursor comprises determining one of the cursor's color, shape, size, and graphics.
