Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera

A computer program product comprising a non-transitory medium for embodying a computer program for input to a computer and a computer program embodied in the non-transitory medium for causing the computer to perform steps comprising:

• establishing communications with an image capture device that is capable of providing first output data that includes depth measurements;
• using the image capture device to capture images of an object as the object moves in a three-dimensional manner;
• receiving the first output data provided by the image capture device as the image capture device captures images of the object;
• receiving additional output data from at least one sensor other than the image capture device that can be used to determine motion and/or orientation of the object, wherein the at least one sensor other than the image capture device does not comprise an image capture device;
• tracking the three-dimensional movements of the object by mixing the first output data provided by the image capture device with the additional output data provided by the at least one sensor other than the image capture device;
• and
• changing weights that are applied to the first output data and the additional output data in the mixing;
• wherein the image capture device comprises a three-dimensional camera that measures a depth of a pixel and determines a distance of the pixel from the camera;
• and
• wherein the object comprises a controller comprising one or more light sources.

An apparatus, comprising:

• an image capture device that is capable of providing first output data that includes depth measurements;
• and
• a processing system that is communicatively coupled to the image capture device, wherein the processing system is configured to execute steps comprising using the image capture device to capture images of an object as the object moves in a three-dimensional manner, receiving the first output data provided by the image capture device as the image capture device captures images of the object, receiving additional output data from at least one sensor other than the image capture device that can be used to determine motion and/or orientation of the object, tracking the three-dimensional movements of the object by mixing the first output data provided by the image capture device with the additional output data provided by the at least one sensor other than the image capture device, and changing weights that are applied to the first output data and the additional output data in the mixing;
• wherein the at least one sensor other than the image capture device does not comprise an image capture device;
• wherein the image capture device comprises a three-dimensional camera that measures a depth of a pixel and determines a distance of the pixel from the camera;
• and
• wherein the object comprises a controller comprising one or more light sources.