# US 6,731,330 B2 · Method for robust determination of visible points of a controllable display within a camera view

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 6,731,330 B2
- Document ID: US6731330B2
- Status: Granted
- Kind: B2
- Application number: 09/774,452
- Filed: 2001-01-30
- Published: 2002-09-12
- Granted: 2004-05-04
- Earliest claimed: 2001-01-30
- Assignees: Hewlett-Packard Development Company, L.P.
- Inventors: I-Jong Lin
- Web page: https://patentgrep.com/patent/US6731330B2

## CPC

- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A system and method of locating the display area of a user interactive, computer controlled display including a computing device for generating image data corresponding to a plurality of selected images, a display area for displaying the plurality of selected images, an image capture device for capturing a plurality of images within its capture area each captured image including one of the selected images and a display area locator for locating the display area within the capture area by deriving constructive and destructive feedback data from image data corresponding to the plurality of captured images.

## Claims

### Claim 1

A method for determining the location of a computer controlled display area within an image capture area of an image capture device:
displaying a plurality of selected images within the display area;
capturing a plurality of images within the capture area of the image capture device each including one of the displayed selected images; and
deriving constructive and destructive feedback data from image data corresponding to the plurality of captured images;
wherein displaying the plurality of selected images comprises displaying at least three images including, a first selected image having a first single intensity grayscale value I1, displaying a second selected image having a second single intensity grayscale value I2 and displaying a third selected image having a third single intensity grayscale value I3, wherein I1>I2>I3.

### Claim 2 (depends on 1)

The method as described in claim 1 wherein the second single intensity grayscale value corresponds to one of a maximum intensity level and a minimum intensity level, the third single intensity grayscale value corresponds to the other of the maximum intensity level and the minimum intensity level, and the first single intensity grayscale value is a value between the maximum and minimum intensity values.

### Claim 3 (depends on 1)

The method as described in claim 1 wherein displaying a plurality of selected images comprises displaying each of the second selected and the third selected images such that first regions have a corresponding intensity value I2 and second regions have a corresponding intensity value I3.

### Claim 4 (depends on 1)

The method as described in claim 1 wherein deriving constructive and destructive feedback data from the image data comprises:
storing the image data corresponding to a first captured image of the plurality of captured images which includes the first selected image in a pixel array associated with the capture area; and
one of incrementing and decrementing pixel values in the pixel array dependent on the image data corresponding to a second captured image of the plurality of captured images including the second selected image and dependent on the image data corresponding to a third captured image of the plurality of captured images including the third selected image.

### Claim 5 (depends on 4)

The method as described in claim 4 wherein the pixel values are incremented by a first predetermined constant value and the pixel values are decremented by a second predetermined constant value.

### Claim 6 (depends on 4)

The method as described in claim 4 wherein pixel values corresponding to the display area within the capture area are incremented so as to create the constructive feedback data and pixel values not corresponding to the display area are decremented so as to create the destructive feedback data.

### Claim 7 (depends on 4)

The method as described in claim 4 wherein incrementing and decrementing pixel values further comprises comparing captured image data of the first captured image to image data corresponding to each of the second captured image and the third captured image and incrementing and decrementing dependent on the comparison results.

### Claim 8 (depends on 7)

The method as described in claim 7 wherein comparing further comprises comparing pixel values of the first captured image data to corresponding noise adjusted pixel values of each of the second captured image and the third captured image data, wherein the noise adjusted pixel value comprises the original pixel value plus a noise factor value.

### Claim 9 (depends on 4)

The method as described in claim 4 wherein the display area is a projection screen and the image capture device is a digital camera.

### Claim 10

A system comprising:
a computing system;
a display area controlled by the computing system to display a plurality of selected images within the display area;
an image capture device having an image capture area for capturing a plurality of images within the capture area each including one of the selected displayed images;
a display area locator for deriving constructive and destructive feedback data from image data corresponding to the plurality of captured images;
wherein displaying the plurality of selected images comprises displaying at least three images including, a first selected image having a first single intensity grayscale value I1, displaying a second selected image having a second single intensity grayscale value I2 and displaying a third selected image having a third single intensity grayscale value I3, wherein I1>I2>I3.

### Claim 11 (depends on 10)

The system as described in claim 10 wherein the second single intensity grayscale value corresponds to one of a maximum intensity level and a minimum intensity level, the third single intensity grayscale value corresponds to the other of the maximum intensity level and the minimum intensity level, and the first single intensity grayscale value is a value between the maximum and minimum intensity values.

### Claim 12 (depends on 10)

The system as described in claim 10 wherein the second selected image includes a first region having a corresponding intensity value I2 and second region have a corresponding intensity value I3 and the third selected image includes the first region having a corresponding intensity value I3 and the second region have a corresponding intensity value I2.

### Claim 13 (depends on 10)

The system as described in claim 10 further comprising:
a means for storing an array of pixel values associated with the image data corresponding to a first captured image of the plurality of captured images, the first captured image including a first selected image of the plurality of selected images; and
a means for one of incrementing and decrementing the pixel values dependent on the image data corresponding to the remainder of the plurality of captured images.

### Claim 14 (depends on 13)

The system as described in claim 13 wherein the pixel values are incremented by a first predetermined constant value and the pixel values are decremented by a second predetermined constant value.

### Claim 15 (depends on 13)

The system as described in claim 13 wherein pixel values corresponding to the display area within the capture area are incremented so as to create the constructive feedback data and pixel values not corresponding to the display area are decremented so as to create the destructive feedback data.

### Claim 16 (depends on 13)

The system as described in claim 13 wherein the display area is a projection screen and the image capture device is a digital camera.

### Claim 17

A apparatus for determining the location of a computer controlled display area within an image capture area of an image capture device comprising:
a means for storing image data corresponding to at least one of a plurality of captured images each captured image including one of a plurality of selected images displayed within the display;
a means for deriving constructive and destructive feedback data from the image data corresponding to the plurality of captured images;
wherein displaying the plurality of selected images comprises displaying at least three images including, a first selected image having a first single intensity grayscale value I1, displaying a second selected image having a second single intensity grayscale value I2 and displaying a third selected image having a third single intensity grayscale value I3, wherein I1>I2>I3.

### Claim 18 (depends on 17)

The apparatus as described in claim 17 wherein the derivation means comprises:
a means for comparing stored image data corresponding to a first captured image of the plurality of captured images to second and third image data corresponding to each of second and third captured images of the plurality of captured images; and
a means for one of incrementing and decrementing the stored image data dependent on the comparison of the image data.
