Interacting with a computer based application

One or more processor readable hardware storage devices having processor readable code embodied on the one or more processor readable hardware storage devices, the processor readable code for programming one or more processors to perform a method comprising:

• performing a video game including interacting with one or more users who are bound to the video game;
• receiving information from a first sensor about moving objects, the moving objects include the one or more bound users and one or more persons who are not bound to the video game;
• during the video game, automatically tracking and characterizing motion of the one or more bound users and the one or more persons who are not bound to the video game based at least in part on the information from the first sensor including recognizing different types of motion being performed by the one or more bound users as compared to the one or more persons who are not bound to the video game, the tracking and characterizing motion of the one or more bound users includes skeletal tracking using one or more models of the bodies of the one or more bound users, the tracking and characterizing motion of the one or more persons who are not bound to the video game includes skeletal tracking using one or more models of the bodies of the one or more persons who are not bound to the video game;
• and
• automatically changing the computer based video game in response to the tracked and characterized motion of the one or more bound users and one or more persons who are not bound to the video game.

A computing system, comprising:

• a camera;
• and
• a computer connected to the camera, the computer includes:
• a tracking engine to receive data from the camera, the tracking engine operable to provide output information indicative of tracking,
• a software application for communication with the tracking engine, the software application operable to interact with one or more actively engaged users based on the output information from the tracking engine and operable to interact with one or more entities not actively engaged with the software application, the tracking engine operable to track motion of limbs of the one or more entities not actively engaged with the software application, the output information includes information about the tracked motion of limbs of the one or more entities not actively engaged with the software application,
• a recognizer engine to receive data from the camera and the output information from the tracking engine, and
• a plurality of filters, the recognizer engine operable to selectively provide the data from the camera and output information from the tracking engine to one or more of the filters as input data, each filter of the plurality of filters configured to test for a different predetermined motion and configured to output to the software application whether one or more entities not actively engaged with the software application have performed the respective predetermined motion based on the tracking of motion of limbs of the one or more entities not actively engaged with the software application, the software application operable to make a change to a runtime condition reported in a user interface of the software application in response to one or more of the filters indicating that one or more entities not actively engaged with the software application have performed a predetermined action.