# US 2006/0152487 A1 · Handheld device for handheld vision based absolute pointing system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2006/0152487 A1
- Document ID: US20060152487A1
- Status: Published application
- Kind: A1
- Application number: 11/187,387
- Filed: 2005-07-21
- Published: 2006-07-13
- Earliest claimed: 2005-01-12
- Assignees: Thinkoptics, Inc.
- Inventors: Anders Grunnet-Jepsen; Kenneth Salsman; John Sweetser
- Web page: https://patentgrep.com/patent/US20060152487A1

## CPC

- G06F 3/0325: {using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method is described that involves detecting one or more images appearing on a pixilated sensor of respective one or more fixed markers. The pixilated sensor is within a handheld device. For each of the images, determining its location on the sensor with the handheld device's electronic circuitry. Translating the images' determined locations into a pointed to location on a display, or proximate to said display, wherein the handheld device transmits information derived from the determining.

## Claims

### Claim 1

A method, comprising:
detecting one or more images appearing on a pixilated sensor of respective one or more fixed markers, said pixilated sensor within a handheld device;
for each of said images, determining its location on said sensor with said handheld device's electronic circuitry;
translating said images' determined locations into a pointed to location on a display, or proximate to said display, wherein said handheld device transmits information derived from said determining.

### Claim 2 (depends on 1)

The method of claim 1 wherein said handheld device transmits data describing each location of each image.

### Claim 3 (depends on 1)

The method of claim 1 wherein said handheld device performs said translating.

### Claim 4 (depends on 3)

The method of claim 3 wherein said handheld transmits data describing said pointed to location.

### Claim 5 (depends on 1)

The method of claim 1 wherein said determining further comprises:
using data taken from said sensor from within a region of pixels that surround one of said images:
summing across said data in a first direction and in a second direction;
fitting a first curve to a first profile that results from said summing in said first direction;
fitting a second curve to a second profile that results from said summing in a second direction;
identifying as a first coordinate of said one image's location a center of said first curve;
identifying as a second coordinate of said image's location a center of said second curve.

### Claim 6 (depends on 5)

The method of claim 5 wherein said first direction is along a row of said sensor's pixels and said second direction is along a column of said sensor's pixels.

### Claim 7 (depends on 1)

The method of claim 1 wherein said translating further comprises:
determining a distance and/or viewing angle between said handheld device and said display;
calculating a scaling factor from said distance and/or viewing angle;
scaling said images' determined locations relative to reference locations identified for said images with said scaling factor.

### Claim 8 (depends on 7)

The method of claim 7 further comprising
sensing said handheld device's orientation and/or changes to said orientation from said images' determined locations.

### Claim 9 (depends on 8)

The method of claim 8 further comprising determining said handheld device's viewing angle.

### Claim 10 (depends on 8)

The method of claim 8 further comprising determining a distance and/or viewing angle between two markers.

### Claim 11 (depends on 9)

The method of claim 9 further comprising determining said handheld device's roll by detecting collective rotation in locations of said images of said markers.

### Claim 12 (depends on 9)

The method of claim 9 further comprising:
determining said handheld device's orientation;
calculating said scaling factor from said distance and/or viewing angle and said orientation.

### Claim 13 (depends on 12)

The method of claim 12 wherein said determining said location further comprises tracking changes in the separation between two or more locations of said images of said markers.

### Claim 14 (depends on 13)

The method of claim 13 wherein said markers act as a source of optical radiation.

### Claim 15 (depends on 13)

The method of claim 13 wherein said markers reflect optical radiation detected by said handheld device's sensor.

### Claim 16 (depends on 1)

The method of claim 1 wherein said location is defined to a size that is fraction of a pixel.

### Claim 17

A handheld device comprising a machine and executable program code, said executable program code stored on a non volatile memory, said executable program code to be executed by said machine, said executable program code to perform a method, said method comprising:
reading data describing images of one or more fixed markers detected by a pixilated sensor located in said handheld device.

### Claim 18 (depends on 17)

The handheld device of claim 17 wherein said method further comprises:
for each of said images, determining its location on said sensor.

### Claim 19 (depends on 18)

The handheld device of claim 18 wherein said location is defined with a resolution that is smaller than a pixel.

### Claim 20 (depends on 17)

The handheld device of claim 17 wherein said method further comprises:
using data taken from said sensor from within a region of pixels that surround one of said images:
summing across said data in a first direction and in a second direction;
fitting a first curve to a first profile that results from said summing in said first direction;
fitting a second curve to a second profile that results from said summing in a second direction;
identifying as a first coordinate of said one image's location a center of said first curve;
identifying as a second coordinate of said image's location a center of said second curve.

### Claim 21 (depends on 20)

The handheld device of claim 20 wherein said first direction is along a row of said sensor's pixels and said second direction is along a column of said sensor's pixels.

### Claim 22 (depends on 17)

The handheld device of claim 17 wherein said method further comprises causing said handheld device to send data describing each location of each said images.

### Claim 23 (depends on 17)

The handheld device of claim 17 wherein said method further comprises:
translating said images' determined locations into a pointed to location on a display.

### Claim 24 (depends on 23)

The handheld device of claim 23 wherein said translating further comprises:
calculating a scaling factor with a distance and/or viewing angle between said handheld device and said display determined from said determined locations;
scaling said images' determined locations relative to reference locations identified for said images with said scaling factor.

### Claim 25 (depends on 24)

The handheld device of claim 24 wherein said method further comprises:
sensing said handheld device's orientation and/or changes to said orientation from said images' determined locations

### Claim 26 (depends on 25)

The handheld device of claim 25 wherein said method further comprises determining said handheld device's roll by detecting collective rotation in locations of said images of said markers.

### Claim 27 (depends on 24)

The handheld device of claim 24 wherein said method further comprises:
determining said handheld device's viewing angle;
calculating said scaling factor from said distance and said viewing angle.

### Claim 28 (depends on 24)

The handheld device of claim 24 wherein said distance and/or viewing angle is determined by tracking changes in the separation between two or more locations of said images of said markers.

### Claim 29 (depends on 17)

The handheld device of claim 17 wherein said markers act as a source of optical radiation.

### Claim 30 (depends on 17)

The handheld device of claim 17 wherein said markers reflect light detected by said handheld device's sensor.

### Claim 30 (depends on 23)

The handheld device of claim 23 wherein said method further comprises causing data describing said pointed to location on said display to be transmitted.

### Claim 31 (depends on 17)

The handheld device of claim 17 wherein a diffuser is found within an optical channel that runs between an aperture located on a front face of said handheld device and said pixilated sensor.

### Claim 32 (depends on 17)

The handheld device of claim 17 wherein a filter is found within an optical channel that runs between an aperture located on a front face of said handheld device and said pixilated sensor.

### Claim 33 (depends on 17)

The handheld device of claim 17 wherein said machine is a processor.

### Claim 34 (depends on 17)

The handheld device of claim 17 wherein said machine is a controller.
