Predictive Determination
AssigneeMicrosoft Corporation
InventorsRelja Markovic, Gregory N. Snook, Justin McBride
Life of this patent
Estimating the term…
Abstract
Systems, methods and computer readable media are disclosed for a gesture recognizer system architecture. A recognizer engine is provided, which receives user motion data and provides that data to a plurality of filters. A filter corresponds to a gesture, that may then be tuned by an application receiving information from the gesture recognizer so that the specific parameters of the gesture—such as an arm acceleration for a throwing gesture—may be set on a per-application level, or multiple times within a single application. Each filter may output to an application using it a confidence level that the corresponding gesture occurred, as well as further details about the user motion data.
Claims20
A method for predicting a gesture made by a user to a first application, comprising:
- receiving image data captured by a depth camera, wherein the image data comprises depth information and is representative of a motion or pose performed by the user;
- applying a filter to the image data to interpret a gesture, wherein the filter comprises a first parameter about the gesture and a second parameter about the gesture, the first parameter corresponding to an earlier part of the gesture than the second parameter;
- determining, from the applied filter, an output corresponding to the gesture being performed, wherein determining the output includes determining the output corresponds to a high confidence level when the first parameter corresponds to a high confidence level and the second parameter does not correspond to a high confidence level;
- and
- sending the first application the output.
A method for processing a gesture made by a user to a first application, comprising:
- receiving image data captured by a depth camera, wherein the image data comprises depth information and is representative of a motion or pose performed by the user;
- determining an output from the filter based on the image data;
- sending the application the output
- applying a second filter to the image data to interpret the image data, the second filter representing a second gesture and comprising base information about the second gesture;
- determining, from the applied second filter, a second output corresponding to the second gesture being performed and a context, the second output being indicative of a greater confidence level than the output;
- and
- sending the application the second output.
A computer readable storage medium, comprising computer readable instructions that when executed on a computer, cause the computer to perform operations comprising:
- receiving from a first application of the a plurality of applications a value for at least one parameter;
- receiving image data captured by a depth camera, wherein the image data comprises depth information and is representative of a motion or pose performed by the user;
- applying the filter to the image data to interpret the image data, wherein the filter comprises a first parameter and a second parameter about a gesture, the first parameter corresponding to an earlier part of the gesture than the second parameter;
- determining a confidence level that the image data is indicative of the gesture, wherein determining the confidence level includes determining the confidence level corresponds to a high confidence level when the first parameter corresponds to a high confidence level and the second parameter does not correspond to a high confidence level;
- and
- sending the first application an indication of the gesture with its associated confidence level.
Dependencies are inferred from the claim text.