Three-dimensional (3D) human-computer interaction system using computer mouse as a 3D pointing device and an operation method thereof

In a computing system environment, a method for three-dimensional pointing and/or data input, comprising:

• moving at least one pointing/input device in a three-dimensional space within a field of view of a multi-view imaging device operably connected to a computing device having at least one processor, at least one memory, and at least one graphical user interface;
• by the multi-view imaging device, capturing a plurality of sequential image frames with each image frame providing at least two views of a scene including the at least one pointing/input device;
• from the captured image frames, calculating at least a spatial and a velocity parameter of the at least one pointing/input device when moved through the three-dimensional space;
• and
• rendering, on the graphical user interface, a visual marker corresponding to the spatial and velocity parameters of the at least one pointing/input device in three-dimensional space;
• wherein the at least one pointing device includes a plurality of visible indicia on a surface thereof.

A three-dimensional user interface system, comprising:

• at least one pointing/input device including a plurality of actuable visible indicia on a surface thereof;
• a multi-view imaging device configured for capturing a plurality of sequential image frames, the multi-view imaging device comprising a single lens video recording device operably linked to a reflector for providing at least two different views of a scene comprising the at least one pointing/input device per each image frame captured and an image sensor for converting the captured image frames into digital data;
• and
• at least one computer program product operable on a computing device having at least one processor, at least one memory, and at least one graphical user interface;
• wherein the at least one computer program product includes executable instructions for calculating from the plurality of captured sequential image frames at least a spatial and a velocity parameter of the at least one pointing/input device when moved through a three-dimensional space, and for rendering, on the graphical user interface, a visual marker corresponding to the spatial and velocity parameters of the at least one pointing/input device in three-dimensional space;
• further wherein the plurality of visible indicia provide a reference point for the multi-view imaging device.