# US 2014/0152565 A1 · Easily deployable interactive direct-pointing system and presentation control system and calibration method therefor > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0152565 A1 - Document ID: US20140152565A1 - Status: Published application - Kind: A1 - Application number: 14/175,960 - Filed: 2014-02-07 - Published: 2014-06-05 - Earliest claimed: 2004-05-28 - Assignees: UltimatePointer, L.L.C. - Applicants: UltimatePointer, L.L.C. - Inventors: Erik Jan Banning - Web page: https://patentgrep.com/patent/US20140152565A1 ## CPC - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G03B 21/00: Projectors or projection-type viewers; Accessories therefor (devices for changing pictures G03B23/00) - G03B 21/006: {using LCD's} - G06F 3/005: {Input arrangements through a video camera} - G06F 3/012: {Head tracking input arrangements} - G06F 3/033: Pointing devices displaced or positioned by the user {, e.g. mice, trackballs, pens or joysticks}; Accessories therefor (digitisers characterised by the transducing means G06F3/041) - G06F 3/0338: with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks - G06F 3/03549: {Trackballs (G06F3/03541 takes precedence)} - G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) ## Abstract A method for controlling movement of a computer display cursor based on a point-of-aim of a pointing device within an interaction region includes projecting an image of a computer display to create the interaction region. At least one calibration point having a predetermined relation to said interaction region is established. A pointing line is directed to substantially pass through the calibration point while measuring a position of and an orientation of the pointing device. The pointing line has a predetermined relationship to said pointing device. Movement of the cursor is controlled within the interaction region using measurements of the position of and the orientation of the pointing device. ## Claims ### Claim 1 A pointing device for controlling a feature on an image generated by a computer, comprising: a handheld enclosure having a predetermined relation to a pointing line; a sensing device for generating data, with first data of said sensing device dependent on a first orientation of said enclosure at a first position while the pointing line is directed at a first calibration point, said first calibration point having a predetermined relation to the image, and with second data of said sensing device dependent on a second orientation of said enclosure at substantially said first position while the pointing line is directed at a non-calibration point on the image, said sensing device including an image capturing device; and a communication element coupled to said sensing device for providing third data to the computer for controlling the feature on the image, said third data being based on said first data or said second data, wherein the feature on the image can be controlled based on the relation between the first orientation and the second orientation of said enclosure. ### Claim 2 (depends on 1) The pointing device according to claim 1, wherein fourth data of said sensing device is dependent on a third orientation of said enclosure at substantially said first position while the pointing line is directed at a second calibration point, said second calibration point having a predetermined relation to the computer image, wherein said third data is further based on said first data, said second data or said fourth data, and wherein the feature on the image can be further controlled based on the relation between the third orientation and the second orientation and the first orientation of said enclosure. ### Claim 3 (depends on 2) The pointing device according to claim 2, wherein said sensing device further includes at least one of an accelerometer, a gravity sensor, a magnetometer, a gyroscope and an inclinometer. ### Claim 4 (depends on 1) The pointing device according to claim 1, wherein said sensing device further includes an accelerometer. ### Claim 5 (depends on 1) The pointing device according to claim 1, wherein said sensing device further includes a gravity sensor. ### Claim 6 (depends on 1) The pointing device according to claim 1, wherein said sensing device further includes a magnetometer. ### Claim 7 (depends on 1) The pointing device according to claim 1, wherein said sensing device further includes a gyroscope. ### Claim 9 (depends on 1) The pointing device according to claim 1, wherein said sensing device further includes an inclinometer. ### Claim 11 (depends on 1) The pointing device according to claim 1, wherein said sensing device further includes a gyroscope and an accelerometer. ### Claim 12 A device for providing first data for use in controlling positional coordinates of a feature on a computer-generated image, the device comprising: an enclosure designed to be handheld by a user and operated by the user in mid-air; an accelerometer located in said enclosure for providing a first output signal; a gyroscope located in said enclosure for providing a second output signal; a user input device located in said enclosure for providing a user output signal, said user input device allowing a user to provide directional inputs; a light source located in said enclosure and configured for use in collecting data dependent on distance; at least one of a connection to an external first power source and an internal second power source for providing power to devices located in said enclosure; and a communication element located in said enclosure and coupled to said accelerometer, said gyroscope, and said user input device, said communication element including a unique identification value, for providing first data dependent on said first output signal and said second output signal and for providing second data dependent on said user output signal. ### Claim 13 (depends on 12) The device according to claim 12, further comprising: a magnetometer located in said enclosure and coupled to said communication element for providing a third output signal, wherein first data provided by said communication element is further dependent on said third output signal. ### Claim 14 (depends on 12) The device according to claim 12, wherein said enclosure is further designed to be directed at a point, wherein said first and second output signals include first calibration data if said device is directed at a first calibration point, said first calibration point having a predetermined relation to the computer-generated image, and wherein said first data which includes said first calibration data can be used to control the feature on the computer-generated image. ### Claim 15 (depends on 14) The device according to claim 14, wherein said first and second output signals include second calibration data if said device is directed at a second calibration point, said second calibration point having a predetermined relation to the computer-generated image and different from said first calibration point, and wherein said first data which includes said second calibration data can be used to control the feature on the computer-generated image. ### Claim 16 (depends on 12) The device according to claim 12, wherein said first and second output signals include first calibration data if said device is placed in a first pre-defined position, and wherein said first data which includes said first calibration data can be used to control the feature on the computer-generated image. ### Claim 17 (depends on 16) The device according to claim 16, wherein said first and second output signals include second calibration data if said device is placed in a second pre-defined position, the second pre-defined position being different than the first pre-defined position, and wherein said first data which includes said second calibration data can be used to control the feature on the computer-generated image. ### Claim 18 (depends on 12) The device according to claim 12, the device further comprising: a microphone located in said enclosure and coupled to said communication element for providing an audio output signal, said communication element providing third data dependent on said audio output signal. ### Claim 19 (depends on 12) The device according to claim 12, wherein said user input device includes a trackball. ### Claim 20 A device for providing first data for use in controlling a feature on a computer-generated image, the device comprising: an enclosure designed to be handheld by a user and operated by the user in mid-air; an accelerometer located in said enclosure for providing a first output signal; a gyroscope located in said enclosure for providing a second output signal; a magnetometer located in said enclosure for providing a third output signal; a user input device located in said enclosure for providing a user output signal, said user input device allowing a user to provide directional inputs; at least one of a connection to an external first power source and an internal second power source for providing power to devices located in said enclosure; and a communication element located in said enclosure and coupled to said accelerometer, said gyroscope, said magnetometer, and said user input device, for providing first data dependent on said first output signal and said second output signal and said third output signal and for providing second data dependent on said user output signal. ### Claim 21 (depends on 20) The device according to claim 20, wherein said controlling a feature comprises controlling positional coordinates of the feature on said computer generated image. ### Claim 22 (depends on 20) The device according to claim 20, the device further comprising: a microphone located in said enclosure and coupled to said communication element for providing an audio output signal, and an image capturing device in said enclosure and coupled to said communication element for providing a video output signal, and wherein said communication element is for providing third data dependent on said audio output signal and said video output signal. ### Claim 23 (depends on 20) The device according to claim 20, wherein said user input device includes a trackball. ### Claim 24 A system for use in controlling two positional coordinates of a feature on a computer-generated image, the system comprising: a first enclosure including: a processing unit; computer program storage coupled to said processing unit; an image generation element coupled to said processing unit and for coupling to an image display device and for providing the computer-generated image; a first power source for providing power to devices located in said first enclosure; and a first enclosure communication element coupled to said processing unit; a second enclosure separate from said first enclosure, said second enclosure including: a level sensing device providing a level sensor output signal; at least one of a connection to an external second power source and an internal third power source for providing power to devices located in said second enclosure; and a second enclosure communication element coupled to said level sensing device and for coupling to said first enclosure communication element, said second enclosure communication element for providing first data dependent on said level sensor output signal; and a third enclosure designed to be handheld and operated by a user in mid-air, said third enclosure separate from said first enclosure and said second enclosure, said third enclosure including: a light source configured for use in collecting data dependent on position of said third enclosure; a user input device configured to allow a user to provide directional inputs and for providing a user output signal; at least one of a connection to an external fourth power source and an internal fifth power source for providing power to devices located in said third enclosure; and a third enclosure communication element coupled to said user input device and for coupling to said first enclosure communication element, said third enclosure communication element for providing second data dependent on said user output signal. ### Claim 25 (depends on 245) The system according to claim 245, wherein said third enclosure communication element includes a unique identification value. ### Claim 26 (depends on 24) The system of claim 24, wherein said third enclosure further includes: a sensing device coupled to said third enclosure communication element for determining the orientation of said third enclosure, said sensing device providing an orientation output signal, wherein said third enclosure communication element is further for providing second data dependent on said orientation output signal. ### Claim 27 (depends on 24) The system according to claim 24, wherein said level sensing device includes an accelerometer. ### Claim 28 (depends on 24) The system according to claim 24, wherein the position is a three dimensional position. ### Claim 29 (depends on 24) The system according to claim 24, wherein the position is a two dimensional position. ### Claim 30 (depends on 24) The system according to claim 24, wherein the position is a one dimensional position. ### Claim 31 A non-transitory computer-readable medium storing computer-executable instructions for directing a processing unit in a computer to perform a method for controlling positional coordinates of a feature on a rectangular computer screen interaction region spanned by a first and a second computer axis, the computer communicating with an enclosure designed to be handheld by a user and operated by the user in mid-air, the enclosure defining a pointing line with a predetermined relation to the enclosure, the pointing line defining a point of aim as the intersection of the pointing line with a rectangular interaction structure, the interaction structure being spanned by a horizontal first structure axis and a vertical second structure axis, the enclosure for providing first data that allows for the complete definition of the orientation of said pointing line in three dimensions, the enclosure comprising an accelerometer for providing a first output signal and a gyro for providing a second output signal, the first data being dependent on the first and second output signals, the method comprising: receiving the first data from the enclosure; and using the first data to control the positional coordinates of the feature, wherein said step of using the first data to control the feature does not depend on the angles between the computer axes and the structure axes and operates so that: first data that is generated while the position of the enclosure is kept substantially fixed while the points of aim substantially lie on a line that is parallel to the first structure axis results in positional coordinates for the feature that substantially lie on a line that is parallel to the first computer axis of the computer screen interaction region, and first data that is generated while the position of the enclosure is kept substantially fixed while the points of aim substantially lie on a line that is parallel to the second structure axis results in positional coordinates for the feature that substantially lie on a line that is parallel to the second computer axis of the computer screen interaction region, whereby the positional coordinates of the feature can be controlled by the user by movement of the enclosure. ### Claim 32 (depends on 31) The non-transitory computer-readable medium according to claim 31, wherein the enclosure further comprises an image capturing device for providing a third output signal and wherein the first data is furthermore dependent on the third output signal. ### Claim 33 (depends on 32) The non-transitory computer-readable medium according to claim 32, wherein the enclosure further comprises a magnetometer for providing a fourth output signal and wherein the first data is furthermore dependent on the fourth output signal. ### Claim 34 (depends on 31) The non-transitory computer-readable medium according to claim 31, wherein the orientation of the pointing line in three dimensions is completely described by a first and a second angle, and wherein the first output signal is used for determining both the first and the second angle. ### Claim 35 (depends on 34) The non-transitory computer-readable medium according to claim 34, wherein the enclosure further comprises a magnetometer for providing a third output signal and wherein the first data is furthermore dependent on the third output signal. ### Claim 36 (depends on 31) The non-transitory computer-readable medium according to claim 31, wherein if a first calibration point with a predetermined relation to the interaction structure is identified to the user and the pointing line is directed at the first calibration point, the resulting first data is first calibration data, and wherein said step of using the first data to control the feature further operates so that the first calibration data is used to control the feature. ### Claim 37 (depends on 36) The non-transitory computer-readable medium according to claim 36, wherein if a second calibration point with a predetermined relation to the interaction structure is identified to the user, the second calibration point being different from the first calibration point, and the pointing line is directed at the second calibration point, the resulting first data is second calibration data, and wherein said step of using the first data to control the feature further operates so that the second calibration data is used to control the feature.