Depth sensing infrared input device and associated methods thereof

A method, comprising:

• capturing a plurality of images of a user hand by an infrared camera of a hand tracking device interfacing with a display device, the user hand indicating a first gesture requesting a first action associated with operating the display device;
• wherein the plurality of images include a first image of the user hand taken directly from the user hand by the infrared camera, and at least a second image that is based on a reflection of the user hand at one of a plurality of mirrors located in the hand tracking device;
• wherein the plurality of mirrors includes a first mirror and a second mirror and a third mirror, the first mirror and the second mirror are located across from each other and oriented in a vertical direction from a first surface that includes the infrared camera;
• detecting by the hand tracking device, the first gesture from a three-dimensional image generated from the plurality of images;
• wherein the hand tracking device utilizes a trained model to detect the first gesture based on stored plurality of input gestures, each gesture corresponding to one of a plurality three-dimensional images of user hands;
• executing a first operation by the display device in response to the detected first gesture;
• and
• monitoring the user hand by the hand tracking device using the infrared camera and the plurality of mirrors to detect a second gesture from the trained model for executing a second operation.

A hand tracking device, comprising:

• a first infrared camera for capturing a plurality of images of a user hand indicating a first gesture for requesting a first action associated with operating a display device;
• wherein the hand tracking device utilizes the plurality of images to generate a three-dimensional image of the user hand;
• and detects the first gesture from the three-dimensional image using a trained model that stores a plurality of input gestures corresponding to three-dimensional images of user hands;
• wherein a first operation is executed in response to the detected first gesture;
• and the hand tracking device continuously monitors the user hand to detect a second gesture from the trained model for executing a second operation;
• and
• a plurality of mirrors that provide reflections of the user hand, and the first infra-red camera takes a direct image of the user hand and images of the reflections of the user hand;
• wherein the plurality of mirrors includes a first mirror, a second mirror and a third mirror, the first mirror and the second mirror are located across from each other, and oriented in a vertical direction from a bottom surface of the hand tracking device that includes the first infrared camera.

A non-transitory, machine-readable storage medium having stored thereon instructions for performing a method, comprising machine executable code which when executed by a hand tracking device, causes the hand tracking device to:

• capture a plurality of images of a user hand by an infrared camera of the hand tracking device interfacing with a display device, the user hand indicating a first gesture requesting a first action associated with operating the display device;
• wherein the plurality of images include a first image of the user hand taken directly from the user hand by the infrared camera, and at least a second image that is based on a reflection of the user hand at one of a plurality of mirrors located in the hand tracking device;
• wherein the plurality of mirrors includes a first mirror and a second mirror and a third mirror, the first mirror and the second mirror are located across from each other and oriented in a vertical direction from a first surface that includes the infrared camera;
• detect the first gesture from a three-dimensional image generated from the plurality of images based on a trained model that stores a plurality of input gestures, each gesture corresponding to one of a plurality three-dimensional images of user hands;
• execute a first operation by the display device in response to the detected first gesture;
• and
• monitor the user hand by the infrared camera and the plurality of mirrors to detect a second gesture from the trained model for executing a second operation.