# US 2015/0102993 A1 · Projector-camera system with an interactive screen

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0102993 A1
- Document ID: US20150102993A1
- Status: Published application
- Kind: A1
- Application number: 14/050,778
- Filed: 2013-10-10
- Published: 2015-04-16
- Earliest claimed: 2013-10-10
- Assignees: OmniVision Technologies, Inc.
- Applicants: Omnivision Technologies, Inc.
- Inventors: Hasan Gadjali; Jin Li; Jizhang Shan
- Web page: https://patentgrep.com/patent/US20150102993A1

## CPC

- G06F 3/0416: {Control or interface arrangements specially adapted for digitisers}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A projector-camera system includes a projector coupled to back project a first image on a translucent diffusing screen. A camera is coupled to capture a second image from a back side of the translucent diffusing screen. The second image includes the first image back projected on the translucent diffusing screen and a shadow of a pointing device cast on a front side of the translucent diffusing screen. The pointing device is on the front side of the translucent diffusing screen and is in close proximity to the translucent diffusing screen. A processing block is coupled to the projector and the camera to generate a third image including the shadow of the pointing device. The processing block is further coupled to activate a command in a main computer coupled to the processing block in response to a relative position of the shadow of the pointing device in the third image.

## Claims

### Claim 1

A projector-camera system, comprising:
a projector coupled to back project a first image on a translucent diffusing screen;
a camera coupled to capture a second image from a back side of the translucent diffusing screen, wherein the second image includes the first image back projected on the translucent diffusing screen and a shadow of a pointing device cast on a front side of the translucent diffusing screen, wherein the pointing device is on the front side of the translucent diffusing screen and is in close proximity to the translucent diffusing screen; and
a processing block coupled to the projector and the camera to subtract the first image from the second image to generate in a third image including the shadow of the pointing device, wherein the processing block is further coupled to equalize and align a size and orientation of the first image is with respect to the second image prior to subtracting first image from the second image, wherein the processing block is further coupled to provide a command to a main computer coupled to the processing block in response to a relative position of the shadow of the pointing device in the third image.

### Claim 2 (depends on 1)

The projector-camera system of claim 1 wherein the pointing device is one of a plurality of pointing devices.

### Claim 3 (depends on 1)

The projector-camera system of claim 1 wherein the pointing device includes a finger of a user.

### Claim 4 (depends on 1)

The projector-camera system of claim 1, wherein the pointing device is in contact with the translucent diffusing screen.

### Claim 5 (depends on 1)

The projector-camera system of claim 1, wherein the processing block is further coupled to transform the shadow of the pointing device in the third image to obtain a sharp point.

### Claim 6 (depends on 5)

The projector-camera system of claim 5, wherein the processing block is coupled to utilize an image processing correlation algorithm to transform the shadow of the pointing device in the third image to obtain the sharp point.

### Claim 7 (depends on 1)

The projector-camera system of claim 1 wherein the main computer is included in the projector-camera system.

### Claim 8 (depends on 1)

The projector-camera system of claim 1 wherein the main computer is coupled to the processing block by a cable.

### Claim 9 (depends on 1)

The projector-camera system of claim 1 wherein the main computer is coupled to the processing block by a wireless connection.

### Claim 10 (depends on 1)

The projector-camera system of claim 1 wherein the back side of the translucent diffusing screen partially reflects incoming light.

### Claim 11 (depends on 1)

The projector-camera system of claim 1 wherein the translucent diffusing screen included in a table.

### Claim 12 (depends on 1)

The projector-camera system of claim 1 wherein the projector-camera system is included in an enclosure including the translucent diffusing screen.

### Claim 13 (depends on 1)

The projector-camera system of claim 1 wherein the projector is a pico projector including a liquid crystal on silicon (LCOS) projection display panel.

### Claim 14

A method of interacting with a screen, comprising:
projecting a first image onto a back side of a translucent diffusing screen;
casting a shadow on a front side of the translucent diffusing screen with a pointing device on the front side of the translucent diffusing screen;
capturing a second image from the back side of the translucent diffusing screen including the shadow cast on the front side of the translucent diffusing screen with the of pointing device;
isolating the shadow cast with the of pointing device on the front side of the translucent diffusing screen;
determining whether a location of the shadow cast on the front side of the translucent diffusing screen with the of pointing device is within a region of a first command; and
activating the first command if the location of the shadow cast on the front side of the translucent diffusing screen is within the region of the first command.

### Claim 15 (depends on 14)

The method of interacting with the screen of claim 14 further comprising illuminating the front side of the translucent diffusing screen with light to cast the shadow on the front side of the translucent diffusing screen with the of pointing device.

### Claim 16 (depends on 14)

The method of interacting with the screen of claim 14 further comprising equalizing and aligning a size and orientation of the first image is with respect to the second image prior to isolating the shadow cast on the front side of the translucent diffusing screen with the of pointing device.

### Claim 17 (depends on 14)

The method of interacting with the screen of claim 14 wherein isolating the shadow cast with the pointing device on the front side of the translucent diffusing screen comprises obtaining a third image by subtracting the first image from the second image.

### Claim 18 (depends on 14)

The method of interacting with the screen of claim 14 further comprising transforming the third image to obtain a sharp point representative of the location of the shadow cast on the front side of the translucent diffusing screen with the of pointing device.

### Claim 19 (depends on 14)

The method of interacting with the screen of claim 14 wherein the pointing device is one of a plurality of pointing devices and the shadow is one of a plurality of shadows cast by the plurality of pointing devices on the front side of the translucent diffusing screen.

### Claim 20 (depends on 18)

The method of interacting with the screen of claim 18 further comprising:
isolating a second one of the plurality of shadows cast by a second one of the plurality of pointing devices on the front side of the translucent diffusing screen;
determining whether a location of the second one of the plurality of shadows cast by a second one of the plurality of pointing devices on the front side of the translucent diffusing screen is within a region of a second command; and
activating the second command if the location of the shadow cast on the front side of the translucent diffusing screen is within the region of the first command.
