Boolean/float controller and gesture recognition system
AssigneeMicrosoft Corporation
InventorMike Palotas
Life of this patent
Estimating the term…
Abstract
A system and method are disclosed for providing input to a software application such as a gaming application. The inputs may be received from one or both of a hand-held controller and a NUI system accepting gestural inputs. In an example, a gesture and controller API receives skeletal pose data from the NUI system and converts that data to Boolean or floating point data. In this way, data from both the controller and the NUI system may be exposed to the software application as easily consumable data in the same format.
Claims20
A content presentation and interaction system, comprising:
- a controller providing tactile control input and communicatively coupled to the content presentation and interaction system, the controller including a plurality of tactile input mechanisms and providing a first set of control inputs to the content presentation and interaction system;
- a target recognition and tracking system communicatively coupled to the content presentation and interaction system, the target recognition and tracking system detecting pose information including skeletal data having absolute and relative positions of body joints;
- and
- a gesture and controller application programming interface for receiving pose information from the target recognition and tracking system and processing the pose information to identify gestural input in a format compatible with a format of the tactile control input.
A method of providing input to a content presentation and interaction system, the method comprising:
- a. receiving tactile controller input from a hand-held controller, the input including Boolean and float values;
- b. receiving gestural input from a target recognition and tracking system, the gestural input including skeletal data having absolute and relative positions of body joints;
- c. receiving a Boolean or float value based on identification of a predefined gesture from the skeletal data;
- and
- d. providing the Boolean and/or float values from said steps a and/or c as inputs to a software application running on the content presentation and interaction system.
A computer readable medium for programming a processor to perform a method of providing input to a gaming console, the method comprising:
- a. receiving tactile controller input from a hand-held controller, the input including Boolean and float values;
- b. receiving gestural input from a target recognition and tracking system, the gestural input including skeletal data having absolute and relative positions of body joints;
- c. receiving speech input via a microphone of the target recognition and tracking system;
- d. analyzing via a processor of the content presentation and interaction system the speech input and skeletal data to discern predefined gestures defined by the speech input, or positions and/or movements of body parts;
- e. assigning a Boolean or float value to a predefined gesture discerned in said step d;
- and
- f. providing the Boolean and/or float values from said steps a and/or e as inputs to a gaming application running on the gaming console.
Dependencies are inferred from the claim text.