Depth sensing infrared input device and associated methods thereof
AssigneePanasonic Avionics Corporation
InventorGurmukh Khabrani
Life of this patent
Estimating the term…
Abstract
Methods and systems are provided for a hand tracking device. The hand tracking device includes a first infrared camera for capturing a plurality of images of a user hand indicating a first gesture for requesting a first action associated with operating a display device. The hand tracking device utilizes the plurality of images to generate a three-dimensional image of the user hand; and detects the first gesture from the three-dimensional image using a trained model that stores a plurality of input gestures corresponding to three-dimensional images of user hands. A first operation is executed in response to the detected first gesture. The hand tracking device continuously monitors the user hand to detect a second gesture from the trained model for executing a second operation.
Claims22
A method, comprising:
- capturing a plurality of images of a user hand by an infrared camera of a hand tracking device interfacing with a display device, the user hand indicating a first gesture requesting a first action associated with operating the display device;
- wherein the plurality of images include a first image of the user hand taken directly from the user hand by the infrared camera, and at least a second image that is based on a reflection of the user hand at one of a plurality of mirrors located in the hand tracking device;
- wherein the plurality of mirrors includes a first mirror and a second mirror and a third mirror, the first mirror and the second mirror are located across from each other and oriented in a vertical direction from a first surface that includes the infrared camera;
- detecting by the hand tracking device, the first gesture from a three-dimensional image generated from the plurality of images;
- wherein the hand tracking device utilizes a trained model to detect the first gesture based on stored plurality of input gestures, each gesture corresponding to one of a plurality three-dimensional images of user hands;
- executing a first operation by the display device in response to the detected first gesture;
- and
- monitoring the user hand by the hand tracking device using the infrared camera and the plurality of mirrors to detect a second gesture from the trained model for executing a second operation.
A hand tracking device, comprising:
- a first infrared camera for capturing a plurality of images of a user hand indicating a first gesture for requesting a first action associated with operating a display device;
- wherein the hand tracking device utilizes the plurality of images to generate a three-dimensional image of the user hand;
- and detects the first gesture from the three-dimensional image using a trained model that stores a plurality of input gestures corresponding to three-dimensional images of user hands;
- wherein a first operation is executed in response to the detected first gesture;
- and the hand tracking device continuously monitors the user hand to detect a second gesture from the trained model for executing a second operation;
- and
- a plurality of mirrors that provide reflections of the user hand, and the first infrared camera takes a direct image of the user hand and images of the reflections of the user hand;
- wherein the plurality of mirrors includes a first mirror, a second mirror and a third mirror, the first mirror and the second mirror are located across from each other, and oriented in a vertical direction from a bottom surface of the hand tracking device that includes the first infrared camera.
A non-transitory, machine-readable storage medium having stored thereon instructions for performing a method, comprising machine executable code which when executed by a hand tracking device, causes the hand tracking device to:
- capture a plurality of images of a user hand by an infrared camera of the hand tracking device interfacing with a display device, the user hand indicating a first gesture requesting a first action associated with operating the display device;
- wherein the plurality of images include a first image of the user hand taken directly from the user hand by the infrared camera, and at least a second image that is based on a reflection of the user hand at one of a plurality of mirrors located in the hand tracking device;
- wherein the plurality of mirrors includes a first mirror and a second mirror and a third mirror, the first mirror and the second mirror are located across from each other and oriented in a vertical direction from a first surface that includes the infrared camera;
- detect the first gesture from a three-dimensional image generated from the plurality of images based on a trained model that stores a plurality of input gestures, each gesture corresponding to one of a plurality three-dimensional images of user hands;
- execute a first operation by the display device in response to the detected first gesture;
- and
- monitor the user hand by the infrared camera and the plurality of mirrors to detect a second gesture from the trained model for executing a second operation.
Dependencies are inferred from the claim text.