# US 8,693,732 B2 · Computer vision gesture based control of a device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,693,732 B2
- Document ID: US8693732B2
- Status: Granted
- Kind: B2
- Application number: 13/939,055
- Filed: 2013-07-10
- Published: 2014-02-13
- Granted: 2014-04-08
- Earliest claimed: 2009-10-13
- Assignees: Pointgrab Ltd.
- Applicants: Pointgrab Ltd.
- Inventors: Eran Eilat; Amir Kaplan; Haim Perski
- Web page: https://patentgrep.com/patent/US8693732B2

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/107: {Static hand or arm}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A system and method are provided for controlling a device based on computer vision. Embodiments of the system and method of the invention are based on receiving a sequence of images of a field of view; detecting movement of at least one object in the images; applying a shape recognition algorithm on the at least one moving object; confirming that the object is a user hand by combining information from at least two images of the object; and tracking the object to control the device.

## Claims

### Claim 1

A method for controlling a device based on computer vision, the method comprising
obtaining a sequence of images of a field of view, each of the images comprising at least one hand;
applying a shape recognition algorithm on the images to identify the at least one hand;
detecting, from the images, movement of the hand;
determining a size of the moving hand relative to the image frame which includes the hand;
and moving a displayed object according to movement of the hand while normalizing movement of the displayed object according to the determined size of the hand.

### Claim 2 (depends on 1)

The method according to claim 1, comprising:
obtaining an indication of a distance of the hand from a camera, the indication of a distance of the hand from the camera being based on the size of the hand relative to the image which includes the hand; and
wherein controlling movement of the object on the display of the device is based on the indication of a distance of the hand from the camera.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the object is a cursor.

### Claim 4 (depends on 2)

The method according to claim 2, further comprising normalizing cursor sensitivity to the size of the hand relative to the image which includes the hand.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the images of the field of view are 2D images.

### Claim 6 (depends on 1)

The method according to claim 1, wherein a change in the sequence of images of the size of the hand is used as a basis for detecting movement of the hand.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the camera is a forward-facing camera.
