US 8,897,491 B2Granted

System for finger recognition and tracking

AssigneeMicrosoft Corporation

InventorsAnthony Ambrus, Kyungsuk David Lee, Andrew Campbell, David Haley, Brian Mount, Albert Robles, Daniel Osborn, Shawn Wright, Nahil Sharkasi, Dave Hill, Daniel McCulloch

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

A system and method are disclosed relating to a pipeline for generating a computer model of a target user, including a hand model of the user's hands and fingers, captured by an image sensor in a NUI system. The computer model represents a best estimate of the position and orientation of a user's hand or hands. The generated hand model may be used by a gaming or other application to determine such things as user gestures and control actions.

Claims17

Dependent claims

A method for generating a model of a user's hand including one or more fingers, comprising:

(a) receiving position data representing a position of a user interacting with a sensor, the position data including at least one of depth and image data representing the user's hand;
and
(b) analyzing the position data to identify the user's hand in the position data, said step (b) including the steps of:
(b)(1) analyzing depth data from the position data captured in said step (a) to segment the position data into data of the hand, and
(b)(2) extracting a set of feature descriptors by applying one or more filters to the image data of the hand identified in said step (b)(1), the one or more filters analyzing image data of the hand as compared to image data outside of a boundary of the hand to discern features of the hand including a shape and orientation of the hand.

2 more elements

A system for generating a model of a user's hand including one or more fingers, the system including a sensing mechanism operatively coupled to a computing device, the system comprising:

a skeletal recognition engine for recognizing at least a portion of a skeleton of a user from received data including at least one of image and depth data;
an image segmentation engine for segmenting one or more regions of the body into a region representing a hand of the user;
and
a descriptor extraction engine for extracting data representative of a hand including one or more fingers and an orientation of the hand, the descriptor extraction engine applying a plurality of filters for analyzing pixels in the region representing the hand, each filter in the plurality of filters determining a position and orientation of the hand, the descriptor extraction engine combining the results of each filter to arrive at a best estimate of the position and orientation of the hand.

1 more element

Dependencies are inferred from the claim text.

Facts

Application: 13/277,011Filed 19 Oct 2011 · us provisional application
Priority: 6 Jun 2011
Published: US 2012/0309532 A16 Dec 2012
Granted: 25 Nov 2014
Term ends: Not estimatedThe source records don’t support an estimate.

Classification20 codes

A63F 13/428
By mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual…:…
A63F 13/213
Characterised by their sensors, purposes or types: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
A63F 13/44
Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment: involving timing of…
G06F 3/0425
By opto-electronic means: using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of…