# US 2008/0189661 A1 · Video user interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0189661 A1
- Document ID: US20080189661A1
- Status: Published application
- Kind: A1
- Application number: 12/025,995
- Filed: 2008-02-05
- Published: 2008-08-07
- Earliest claimed: 2007-02-06
- Assignees: Jazzbo Technology Inc.
- Inventors: Craig D. Gundlach; Bradley Kyle Stephens; Ralph Flores
- Web page: https://patentgrep.com/patent/US20080189661A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Embodiments of the invention provide methods and systems for providing user input to a system. For example, according to one embodiment, a video camera can be used to capture an image of a user and a background scene. Movements of the user can be detected from the video image and correlated to a user interface after initial calibration. Through this correlation, movements of the user can be translated into manipulations of the user interface. These manipulations of the user interface can in turn be used to control the system.

## Claims

### Claim 1

A method for providing user input to a system, the method comprising:
receiving an image of a user from a camera;
detecting movement of the user based on the image of the user;
determining whether the movement of the user corresponds to a target element of a user interface for the system; and
in response to determining that the movement of the user corresponds to the target element of the user interface, manipulating the target element of the user interface according to the movement of the user.

### Claim 2 (depends on 1)

The method of claim 1, further comprising displaying an overlay layer, the overlay layer comprising the image of the user.

### Claim 3 (depends on 2)

The method of claim 2, further comprising displaying an interface layer overlaid on the overlay layer, the interface layer comprising one or more user interface elements including the target element of the user interface.

### Claim 4 (depends on 3)

The method of claim 3, further comprising maintaining a hit-point layer corresponding to both the overlay layer and the interface layer, the hit-point layer comprising a plurality of hit-point clusters corresponding to each of the one or more user interface elements.

### Claim 5 (depends on 4)

The method of claim 4, wherein determining whether the movement of the user corresponds to the target element of the user interface is based on detecting change to one or more hit-points of at least one hit-point cluster corresponding to pixels of the target element and detecting change to one or more hit-points of the at least one hit-point cluster is based on changes to pixels of the overlay layer corresponding to the at least one hit-point cluster.

### Claim 6 (depends on 5)

The method of claim 5, wherein each hit-point cluster comprises a representation of a plurality of corresponding pixels of the overlay layer, the plurality of corresponding pixels arranged in a grid pattern and wherein detecting movement of the user further comprises determining a direction of movement across the grid pattern based on changes to the corresponding pixels of the overlay layer.

### Claim 7 (depends on 1)

The method of claim 1, further comprising controlling the system based on manipulating the target element of the user interface.

### Claim 8

A method for reducing unintended activation of a user interface using video as an input, the method comprising:
receiving the video input from a camera;
identifying a user within a field of view of the camera;
determining a user area around the user;
detecting movement in the field of view of the camera; and
in response to the movement occurring outside of the user area, temporarily disabling the user interface.

### Claim 9 (depends on 1)

The method of claim 1, wherein a scene within the field of view if the camera is logically divided into an overlay layer comprising the video from the camera, an interface layer comprising one or more user interface elements wherein the interface layer is overlaid on and corresponds to the overlay layer, and a hit-point layer corresponding to both the interface layer and the overlay layer and comprising a plurality of hit-point clusters corresponding to areas of the interface layer and the overlay layer.

### Claim 10 (depends on 2)

The method of claim 2, wherein identifying a user comprises identifying hit-point clusters repeatedly detecting movement within the overlay layer.

### Claim 11 (depends on 3)

The method of claim 3, wherein determining a user area comprises identifying hit-point clusters surrounding the user as being within the user area.

### Claim 12 (depends on 2)

The method of claim 2, wherein temporarily disabling the user interface comprises temporarily disregarding motion detected by the hit-point clusters.

### Claim 13 (depends on 5)

The method of claim 5, wherein temporarily disregarding motion detected by the hit point clusters comprises disregarding motion detected by hit-point clusters outside the user area.

### Claim 14 (depends on 2)

The method of claim 2, wherein the hit-point layer comprises a plurality of edge hit-point clusters along each edge of the field of view of the video camera.

### Claim 15 (depends on 7)

The method of claim 7, wherein detecting movement outside the user area comprises detecting movement at one or more edge hot-point clusters.

### Claim 16

A method for reducing errors in a user interface using a camera as an input device, the method comprising:
detecting lighting conditions over a field of view of the camera;
dividing the field of view into a number of zones; and
adjusting sensitivity for detecting movement within each zone based on the lighting conditions of that zone.

### Claim 17 (depends on 1)

The method of claim 1, wherein a scene within the field of view of the camera is logically divided into an overlay layer comprising an image received from the camera, an interface layer comprising one or more user interface elements wherein the interface layer is overlaid on and corresponds to the overlay layer, and a hit-point layer corresponding to both the interface layer and the overlay layer and comprising a plurality of hit-point clusters corresponding to each of the one or more elements of the interface layer.

### Claim 18 (depends on 2)

The method of claim 2, wherein detecting lighting conditions over the field of view of the camera comprises detecting lighting conditions based on the overlay layer.

### Claim 19 (depends on 2)

The method of claim 2, wherein dividing the field of view into a number of zones comprises logically dividing the hit-point layer into a number of zones based on the lighting conditions of the overlay layer.

### Claim 20 (depends on 4)

The method of claim 4, wherein adjusting sensitivity for detecting movement comprises adjusting sensitivity of the hit-point clusters in each zone.

### Claim 21 (depends on 2)

The method of claim 2, further comprising detecting a lighting condition change.

### Claim 22 (depends on 6)

The method of claim 6, further comprising, in response to detecting the lighting condition change:
disabling the hit-point clusters;
detecting lighting conditions over a field of view of the camera;
dividing the field of view into a number of zones;
adjusting sensitivity for detecting movement within each zone based on the lighting conditions of that zone; and
enabling the hit-point clusters.
