# US 2014/0157130 A1 · Providing wireless control of a visual aid based on movement detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0157130 A1
- Document ID: US20140157130A1
- Status: Published application
- Kind: A1
- Application number: 13/705,945
- Filed: 2012-12-05
- Published: 2014-06-05
- Earliest claimed: 2012-12-05
- Assignees: AT&T Mobility II LLC
- Applicants: At&T Mobility II, LLC
- Inventors: J. Brad Webb; Stephen T. Hardin; Zachary O. Morsbach
- Web page: https://patentgrep.com/patent/US20140157130A1

## CPC

- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A system for providing wireless control of a visual aid based on movement detection is disclosed. The system also enables a presenter to gesture at a visual aid and have a pointer be displayed on screens displaying the visual aid. The system may generate a three-dimensional depth image of an environment including a user and a device displaying the visual aid. Additionally, the system may determine a position of the user relative to the environment and to the device based on the three-dimensional image. Furthermore, the system may detect a gesture based on the position of the user and the three-dimensional depth image. If the gesture made by the user matches a predetermined input gesture corresponding to a controller operation for controlling the visual aid, then the controller operation may be executed. The system may display an output of the executed controller operation at a remote device.

## Claims

### Claim 1

A system for providing wireless control of a visual aid based on movement detection, comprising:
a memory that stores instructions; and
a processor that executes the instructions to perform operations, the operations comprising:
generating a three-dimensional depth image of an environment including a user and a device displaying the visual aid;
determining a position of the user relative to the environment and to the device based on the three-dimensional depth image;
detecting a gesture from the user based in part on the position of the user and the three-dimensional depth image;
determining if the gesture from the user matches a predetermined input gesture corresponding to a controller operation for controlling the visual aid;
executing the controller operation if the gesture from the user matches the predetermined input gesture; and
displaying an output of the executed controller operation at an interface of a remote device communicatively linked to the visual aid.

### Claim 2 (depends on 1)

The system of claim 1, wherein the operations further comprise projecting a light grid pattern into the environment, wherein the light grid pattern is utilized to generate the three-dimensional depth image of the environment.

### Claim 3 (depends on 1)

The system of claim 1, wherein the predetermined input gesture comprises pointing a finger from a hand of the user in a direction of the device displaying the visual aid.

### Claim 4 (depends on 3)

The system of claim 3, wherein the controller operation corresponding to the predetermined input gesture comprises generating a visual pointer for the visual aid that moves in a direction corresponding to a movement of the hand of the user.

### Claim 5 (depends on 4)

The system of claim 4, wherein displaying the output comprises displaying the visual pointer at the interface of the remote device communicatively linked to the visual aid.

### Claim 6 (depends on 1)

The system of claim 1, wherein the predetermined input gesture comprises waving a hand of the user in a predetermined direction with respect to the device displaying the visual aid.

### Claim 7 (depends on 6)

The system of claim 6, wherein the controller operation corresponding to the predetermined input gesture comprises changing to a new a digital page in the visual aid.

### Claim 8 (depends on 7)

The system of claim 7, wherein displaying the output comprises displaying the new digital page in the visual aid.

### Claim 9 (depends on 1)

The system of claim 1, wherein the predetermined input gesture comprises pointing a laser pointer laser beam at the device displaying the visual aid.

### Claim 10 (depends on 9)

The system of claim 9, wherein the controller operation corresponding to the predetermined input gesture comprises generating a visual representation of the laser pointer laser beam that moves in a direction corresponding to a movement of the laser pointer laser beam.

### Claim 11 (depends on 10)

The system of claim 10, wherein displaying the output comprises displaying the visual representation of the laser pointer laser beam at the interface of the remote device communicatively linked to the visual aid.

### Claim 12 (depends on 1)

The system of claim 1, wherein the operations further comprise detecting speech from the user and executing a voice command based on the speech from the user to control the visual aid.

### Claim 13

A method for providing wireless control of a visual aid based on movement detection, comprising:
generating a three-dimensional depth image of an environment including a user and a device displaying the visual aid;
determining a position of the user relative to the environment and to the device based on the three-dimensional depth image;
detecting a gesture from the user based in part on the position of the user and the three-dimensional depth image;
determining if the gesture from the user matches a predetermined input gesture corresponding to a controller operation for controlling the visual aid;
executing the controller operation if the gesture from the user matches the predetermined input gesture by utilizing instructions stored in memory and executed by a processor; and
displaying an output of the executed controller operation at an interface of a remote device communicatively linked to the visual aid.

### Claim 14 (depends on 13)

The method of claim 13, further comprising projecting a light grid pattern into the environment, wherein the light grid pattern is utilized to generate the three-dimensional depth image of the environment.

### Claim 15 (depends on 13)

The method of claim 13, wherein the predetermined input gesture comprises pointing a laser pointer laser beam at the device displaying the visual aid.

### Claim 16 (depends on 15)

The method of claim 15, wherein the controller operation corresponding to the predetermined input gesture comprises generating a visual representation of the laser pointer laser beam that moves in a direction corresponding to a movement of the laser pointer laser beam.

### Claim 17 (depends on 16)

The method of claim 16, wherein displaying the output comprises displaying the visual representation of the laser pointer laser beam in the direction corresponding to the movement of the laser point laser beam at the interface of the remote device communicatively linked to the visual aid.

### Claim 18 (depends on 13)

The method of claim 13, wherein the controller operation comprises adjusting a volume associated with the visual aid.

### Claim 19 (depends on 13)

The method of claim 13, wherein the controller operation comprises adjusting media content associated with the visual aid.

### Claim 20

A tangible computer-readable medium comprising instructions, which when executed by a processor, cause the processor to perform operations comprising:
generating a three-dimensional depth image of an environment including a user and a device displaying the visual aid;
determining a position of the user relative to the environment and to the device based on the three-dimensional depth image;
detecting a gesture from the user based in part on the position of the user and the three-dimensional depth image;
determining if the gesture from the user matches a predetermined input gesture corresponding to a controller operation for controlling the visual aid;
executing the controller operation if the gesture from the user matches the predetermined input gesture; and
displaying an output of the executed controller operation at an interface of a remote device communicatively linked to the visual aid.
