# US 2010/0169840 A1 · Method For Recognizing And Tracing Gesture

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0169840 A1
- Document ID: US20100169840A1
- Status: Published application
- Kind: A1
- Application number: 12/344,234
- Filed: 2008-12-25
- Published: 2010-07-01
- Earliest claimed: 2008-12-25
- Assignees: Topseed Technology Corp.
- Inventors: Shoei-Lai CHEN; Che-Hao HSU
- Web page: https://patentgrep.com/patent/US20100169840A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method for recognizing and tracing a gesture fetches a gesture image by an image sensor. The gesture image is processed for recognizing and tracing, and a corresponding action is performed according to the processed result. The gesture image is pre-processed and then a moved image is detected. The moved image is analyzed to obtain a gesture feature. When the gesture feature is corresponding to a moved gesture, a center coordinate of the moved gesture is detected and outputted to control a cursor. When the gesture feature is corresponding to a command gesture, a relevant action command is outputted. Therefore, the method provides cursor movement and command input by user gesture.

## Claims

### Claim 1

A method for recognizing and tracing a gesture to provide an image sensor (10) to fetch a gesture image, the method comprising the steps of:
(a) pre-processing the gesture image;
(b) detecting a largest moved block of the gesture image and defining the largest moved block as a gesture block;
(c) analyzing a feature of the gesture block to determine the gesture block is a moved verification gesture or a command gesture;
(d) determining whether the gesture block is successively changed to a moved gesture when the gesture block is the moved verification gesture;
(e) detecting and tracing a center coordinate of the moved gesture when the gesture block successively changes to the moved gesture, and the moved gesture does not stop moving with duration over an action time; and
(f) outputting the center coordinate of the moved gesture and re-performing the step (a).

### Claim 2 (depends on 1)

The method in claim 1, wherein the step (a) comprising:
(a1) adjusting processed size of the gesture image;
(a2) transferring colors of the gesture image; and
(a3) filtering speckle noises of the gesture image.

### Claim 3 (depends on 1)

The method in claim 1, wherein the step (b) comprising:
(b1) calculating moved portions of the gesture image by utilizing an analysis of dynamic image difference;
(b2) calculating a largest moved area of the gesture image by gathering statistically horizontal projections and vertical projections of the gesture image;
(b3) filling empty holes of the gesture block by utilizing a dilation method; and
(b4) calculating a largest connected area to detect the largest moved block by labeling connected areas.

### Claim 4 (depends on 1)

The method in claim 1, wherein the step (e) comprising:
(e1) detecting the center coordinate of the moved gesture by utilizing the circular Hough transfer; and
(e2) tracing the center coordinate of the moved gesture by utilizing the sum of accumulator table.

### Claim 5 (depends on 1)

The method in claim 1, the step (d) further comprising:
re-performing the step (a) when the gesture block is the moved verification gesture and the gesture block is successively changed to be not a moved gesture.

### Claim 6 (depends on 1)

The method in claim 1, the step (d) further comprising:
outputting an action command corresponded to the command gesture and then re-performing the step (a) when the gesture block is the command gesture.

### Claim 7 (depends on 1)

The method in claim 1, the step (d) further comprising:
re-performing the step (a) when the gesture block is an undefined gesture.

### Claim 8 (depends on 1)

The method in claim 1, the step (e) further comprising:
re-performing the step (a) when the moved gesture stops moving with duration over the action time.

### Claim 9 (depends on 1)

The method in claim 1, the step (e) further comprising:
re-detecting the center coordinate of the moved gesture when the center coordinate of the moved gesture is not detected or traced.

### Claim 10 (depends on 1)

The method in claim 1, wherein the action time is set to be one second.

### Claim 11 (depends on 1)

The method in claim 1, wherein the moved verification gesture is defined as a V-shaped gesture formed by an index finger and a middle finger.

### Claim 12 (depends on 1)

The method in claim 1, wherein the moved gesture is defined as a circle-shaped gesture formed by clenching a fist.

### Claim 13 (depends on 1)

The method in claim 1, wherein the command gesture is defined as a “l”-shaped gesture formed by the index finger.