# US 9,519,828 B2 · Isolate extraneous motions > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,519,828 B2 - Document ID: US9519828B2 - Status: Granted - Kind: B2 - Application number: 14/579,207 - Filed: 2014-12-22 - Published: 2015-04-23 - Granted: 2016-12-13 - Earliest claimed: 2009-05-01 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Gregory Nelson Snook; Relja Markovic; Stephen Gilchrist Latta; Kevin Geisner - Web page: https://patentgrep.com/patent/US9519828B2 ## CPC - G06V 40/23: {Recognition of whole body movements, e.g. for sport training} - A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) - G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)} - G06F 2203/012: Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A system may receive image data and capture motion with respect to a target in a physical space and recognize a gesture from the captured motion. It may be desirable to isolate aspects of captured motion to differentiate random and extraneous motions. For example, a gesture may comprise motion of a user's right arm, and it may be desirable to isolate the motion of the user's right arm and exclude an interpretation of any other motion. Thus, the isolated aspect may be the focus of the received data for gesture recognition. Alternately, the isolated aspects may be an aspect of the captured motion that is removed from consideration when identifying a gesture from the captured motion. For example, gesture filters may be modified to correspond to the user's natural lean to eliminate the effect the lean has on the registry of a motion with a gesture filter. ## Claims ### Claim 1 A method for applying a filter representing an intended gesture comprising: adjusting base information representing the intended gesture receiving data captured by a camera, wherein the data is representative of a user's motion in a physical space; predicting the intended gesture from the data; selecting a first portion of the data that is applicable to the intended gesture; and applying the filter representing the intended gesture to the first portion of the data and determining an output from base information representing the intended gesture, wherein the filter comprises the base information representing the intended gesture, and wherein the base information is adjusted to a recurring feature in a history of data representative of the user's motion. ### Claim 2 (depends on 1) The method of claim 1, further comprising applying a plurality of filters to the data, wherein the intended gesture is a gesture corresponding to at least one of the plurality of filters having base information that corresponds to the data. ### Claim 3 (depends on 2) The method of claim 2, further comprising generating a model of the user from the data, wherein the model maps to the first portion of the data that is applicable to the intended gesture and comprises a pre-authored animation that represents a second portion of the data that is not applicable to the intended gesture. ### Claim 4 (depends on 1) The method of claim 1, wherein selecting the first portion of the data that is applicable to the intended gesture comprises selecting a portion of the data that corresponds to a volume of interest. ### Claim 5 (depends on 1) The method of claim 1, wherein a second portion of the data that is not applicable to the intended gesture corresponds to an extraneous motion in the physical space. ### Claim 6 (depends on 5) The method of claim 5, wherein the extraneous motion is a motion of at least one of a second user, an extraneous body part, or an object in the physical space. ### Claim 7 (depends on 5) The method of claim 5, wherein the extraneous motion is a motion in a volume of interest. ### Claim 8 (depends on 5) The method of claim 5, wherein the output is indicative of a failure of the data to register with the filter representing the intended gesture. ### Claim 9 (depends on 5) The method of claim 5, wherein the output is a recognition of the intended gesture from the first portion of the data. ### Claim 10 (depends on 9) The method of claim 9, further comprising aborting gesture recognition of the intended gesture when the first portion of the data deviates from the base information in the filter. ### Claim 11 A system for applying a filter representing an intended gesture comprising: memory having stored therein computer-executable instructions; one or more processors operable to execute the computer-executable instructions, wherein the computer-executable instructions comprise instructions for: receiving data captured by a camera, wherein the data is representative of a user's motion in a physical space; predicting the intended gesture from the data; selecting a first portion of the data that is applicable to the intended gesture; and applying the filter representing the intended gesture to the first portion of the data and determining an output from base information representing the intended gesture, wherein the filter comprises the base information representing the intended gesture, and wherein the base information is adjusted to a recurring feature in a history of data representative of the user's motion. ### Claim 12 (depends on 11) The system of claim 11, wherein the computer-executable instructions further comprise instructions for applying a plurality of filters to the data, wherein the intended gesture is a gesture corresponding to at least one of the plurality of filters having base information that corresponds to the data. ### Claim 13 (depends on 12) The system of claim 12, wherein the computer-executable instructions further comprise instructions for generating a model of the user from the data, wherein the model maps to the first portion of the data that is applicable to the intended gesture and comprises a pre-authored animation that represents a second portion of the data that is not applicable to the intended gesture. ### Claim 14 (depends on 11) The system of claim 11, wherein selecting the first portion of the data that is applicable to the intended gesture comprises selecting a portion of the data that corresponds to a volume of interest. ### Claim 15 A computer-readable storage device that is not a signal and that has stored thereon computer-executable instructions comprising instructions for: receiving data captured by a camera, wherein the data is representative of a user's motion in a physical space; predicting an intended gesture from the data; selecting a first portion of the data that is applicable to the intended gesture; and applying a filter representing the intended gesture to the first portion of the data and determining an output from base information representing the intended gesture, wherein the filter comprises the base information representing the intended gesture, and wherein the base information is adjusted to a recurring feature in a history of data representative of the user's motion. ### Claim 16 (depends on 15) The computer-readable storage device of claim 15, wherein the computer-executable instructions further comprise instructions for applying a plurality of filters to the data, wherein the intended gesture is a gesture corresponding to at least one of the plurality of filters having base information that corresponds to the data. ### Claim 17 (depends on 16) The computer-readable storage device of claim 16, wherein the computer-executable instructions further comprise instructions for generating a model of the user from the data, wherein the model maps to the first portion of the data that is applicable to the intended gesture and comprises a pre-authored animation that represents a second portion of the data that is not applicable to the intended gesture. ### Claim 18 (depends on 15) The computer-readable storage device of claim 15, wherein selecting the first portion of the data that is applicable to the intended gesture comprises selecting a portion of the data that corresponds to a volume of interest.