# US 2017/0285759 A1 · System and method for recognizing hand gesture

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0285759 A1
- Document ID: US20170285759A1
- Status: Published application
- Kind: A1
- Application number: 15/273,386
- Filed: 2016-09-22
- Published: 2017-10-05
- Earliest claimed: 2016-03-29
- Assignees: Korea Electronics Technology Institute
- Applicants: Korea Electronics Technology Institute
- Inventors: Yang Keun Ahn; Young Choong Park
- Web page: https://patentgrep.com/patent/US20170285759A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/005: {Input arrangements through a video camera}
- G06T 7/33: using feature-based methods
- G06V 40/11: {Hand-related biometrics; Hand pose recognition}
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/30196: Human being; Person
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Provided is a hand gesture recognition technique. A hand gesture recognition system according to one aspect of the present invention includes an image capturing unit that captures an image of a gesture recognition region to acquire a depth image; a hand region extractor that extracts a hand region from the depth image; and a hand gesture recognizer that analyzes the extracted hand region to recognize a hand gesture included in the depth image as a grasp gesture or a release gesture.

## Claims

### Claim 1

A hand gesture recognition system comprising:
an image capturing unit that captures an image of a gesture recognition region to acquire a depth image;
a hand region extractor that extracts a hand region from the depth image; and
a hand gesture recognizer that analyzes the extracted hand region to recognize a hand gesture included in the depth image as a grasp gesture or a release gesture, wherein the hand region extractor primarily binarizes the depth image, determines a hand region from the primarily binarized depth image, secondarily binarizes the determined hand region, and finally extracts the hand region,
wherein the hand region extractor compares hand region candidates detected by applying a labeling algorithm to the primarily binarized depth image and a preset threshold, and determines a hand region candidate which is greater than or equal to the threshold as the hand region, and
wherein the hand region recognizer adaptively binarizes the extracted hand region to detect gesture recognition regions, and recognizes the hand gesture as a release gesture or a grasp gesture on the basis of the number of the extracted gesture recognition regions.

### Claim 2

(canceled)

### Claim 3

(canceled)

### Claim 4

(canceled)

### Claim 5

A method of recognizing a hand gesture comprising:
acquiring a depth image by capturing an image of a gesture recognition region;
analyzing the depth image and determining whether a hand region is extracted;
detecting gesture recognition regions by adaptively binarizing an extracted hand region when the hand region is extracted; and
recognizing a hand gesture included in the depth image as a release gesture or a grasp gesture on the basis of the number of the extracted gesture recognition regions, wherein the determining of whether a hand region is extracted includes primarily binarizing the depth image, determining a hand region from the primarily binarized depth image, secondarily binarizing the determined hand region, and finally extracting the hand region,
wherein the determining of whether a hand region is extracted includes comparing hand region candidates detected by applying a labeling algorithm to the primarily binarized depth image and a preset threshold, and determining a hand region candidate which is greater than or equal to the threshold as the hand region, and
wherein the recognizing includes determining whether the number of the gesture recognition regions is greater than or equal to a preset value, and, when the number of the gesture recognition regions is greater than or equal to the preset value, recognizing the hand gesture as a release gesture, and when the number of the gesture recognition regions is less than the preset value, recognizing the hand gesture as a grasp gesture.

### Claim 6

(canceled)

### Claim 7

(canceled)

### Claim 8

(canceled)

### Claim 9 (depends on 1)

The system of claim 1, wherein the hand gesture recognizer recognizes a hand gesture as a release gesture when the number of the gesture recognition regions is three or more, and wherein the hand gesture recognizer recognizes a hand gesture as a grasp gesture when the number of the gesture recognition regions is two or less.

### Claim 10 (depends on 5)

The method of claim 5, wherein the recognizing further includes i) recognizing a hand gesture as a release gesture when the number of the gesture recognition regions is three or more and ii) recognizing a hand gesture as a grasp gesture when the number of the gesture recognition regions is two or less.
