Back to results
US 2015/0145830 A1Published application
Remote control apparatus and method for performing virtual touch by using information displayed by a projector
AssigneeVtouch Co., Ltd.
InventorSeok-Joong Kim
Life of this patent
Estimating the term…
Abstract
Disclosed is a virtual touch remote control apparatus and method using user's movements (gestures) capable of control electronic devices remotely regardless of existence of a display on the device, by providing additional information display with a projector. The apparatus includes a 3D coordinates calculation unit, an electronic device detection unit, a user detection unit, an electronic device operation controller, and an electronic device information DB for storing device specific information.
Claims12
A remote control apparatus for performing virtual touch by using information displayed by a projector, comprising:
- a 3D coordinates calculation unit for extracting 3D coordinates data of user's body and electronic devices;
- an electronic device detection unit for displaying information with a projector at locations that may be seen by users by recognizing spatial location information and product information of electronic devices using the 3D coordinates data of the electronic devices calculated from the 3D coordinates calculation unit, and producing a virtual touch point region for virtual touch based on direction information corresponding to a straight line between the user and the display projected by a projector;
- a user detection unit for calculating virtual touch points and change of the points thereof on the display projected by a projector for control electronic devices using the 3D coordinates data of user's body calculated from the 3D coordinates calculation unit, and producing command codes based on the change of the calculated virtual touch points for performing preliminarily set controls of the electronic devices;
- an electronic device operation controller for converting the produced command codes into control command signals, and transmitting the control command signals to the corresponding electronic devices when the command codes from the user detection unit are inputted;
- and
- an electronic device information DB for storing device specific information such as manufacturers, names, electronic devices data communication protocols for control of the electronic devices installed at home.
3 more elements
The remote control method for performing virtual touch by using information displayed by a projector, comprising:
- (A) extracting 3D coordinates data of user's body and electronic devices;
- (B) using the extracted 3d coordinates data of electronic devices, detecting the corresponding electronic devices based on the preliminarily stored device information, and displaying the information with a projector at the locations that may be seen by users for performing operations of the electronic devices;
- (C) detecting the corresponding electronic devices by comparing the pre-stored electronic device information with the projector-modeled electronic devices and configuring control signals for controlling the detected electronic devices;
- (D) producing a virtual touch point region for virtual touch by matching the directional information corresponding to a straight line between the user and the display projected by a projector based on the calculated 3D coordinates data of the user's body;
- E) calculating a first space coordinates having 3D coordinates of any one of the user's fingertips and a second space coordinates having 3D coordinates of a midpoint of any one of user's eyes, using 3D coordinates data of the user's body from the calculated 3D coordinates data, and calculating a contact point coordinates between the virtual touch point region and the line connecting the first space coordinates and the second space coordinates;
- (F) if there is changes on the contact point coordinates, producing command codes for control electronic devices corresponding to the preliminarily configured control to the changes by detecting variances on the contact point coordinates;
- and
- (G) converting the produced command codes into control command signals for control the corresponding electronic devices and transmitting the control command signals to the corresponding electronic devices.
5 more elements
Dependencies are inferred from the claim text.