Methods and systems for mapping pointing device on depth map

A system for determining a position of a handheld pointing device, the system comprising:

• a depth sensing device configured to generate a depth map;
• a communication module configured to acquire motion data of a handheld pointing device;
• and
• a computing unit communicatively coupled to the depth sensing device, the computing unit configured to:
• determine one or more motions of one or more user hands on a depth map;
• generate motion data associated with the one or more motions of the one or more user hands;
• determine that the motion of the handheld pointing device is associated with the one or more motions of the one or more user hands;
• and
• determine a current position of the handheld pointing device on the depth map.

A processor-readable nontransitory medium having instructions stored thereon, which when executed by one or more processors, cause the one or more processors to:

• determine one or more motions of one or more user hands on a depth map;
• generate motion data associated with the one or more motions of the one or more user hands;
• acquire motion data of a handheld pointing device;
• determine that the motion of the handheld pointing device is associated with the one or more motions of the one or more user hands;
• and
• determine a current position of the handheld pointing device on the depth map.