# US 2018/0024420 A1 · Projector capable of determining how a moving object interacts with a projected image

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0024420 A1
- Document ID: US20180024420A1
- Status: Published application
- Kind: A1
- Application number: 15/724,214
- Filed: 2017-10-03
- Published: 2018-01-25
- Earliest claimed: 2013-08-15
- Assignees: MEP Tech, Inc.
- Applicants: Mep Tech, Inc.
- Inventors: Donald Roy Mealing; Mark L. Davis; Roger H. Hoole; Matthew L. Stoker; W. Lorenzo Swank; Michael J. Bradshaw
- Web page: https://patentgrep.com/patent/US20180024420A1

## CPC

- G03B 17/54: with projector
- G03B 33/12: using beam-splitting or beam-combining systems, e.g. dichroic mirrors
- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- H04N 9/3164: {using multiple light sources}
- H04N 9/3179: {Video signal processing therefor}
- H04N 9/3194: {including sensor feedback}
- H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A projector that projects a visible image as well as a non-visible image. The non-visible image might be used for any purpose, but an example is in order to provide depth information regarding physical item(s) interacting with the projected visible image. The projector includes multiple projecting units (e.g., one for each pixel to be displayed), each including light-emitting elements configured to emit light in the visible spectrum. Some or all of those projecting units might also include an emitting element for emitting light in the non-visible spectrum so as to collectively emit a non-visible image. Optics may be positioned to project the visible image and the non-visible image. A depth sensing module detects depth of surfaces within the scope of the non-visible image using a reflected portion of the non-visible image. Methods for projecting an image are also disclosed.

## Claims

### Claim 1

A projector, comprising:
at least one projecting unit capable of projecting a visible image and a non-visible image, the non-visible image comprising a pattern superimposed with the visible image;
a camera capable of capturing a reflected portion of the non-visible image, including a portion of the pattern reflected by a moving object over the visible image, the camera also capable of generating image signals corresponding to the portion of the pattern reflected by the moving object; and
a processing module capable of receiving the image signals from the camera and of determining how the moving object interacts with the visible image by processing the image signals.

### Claim 2 (depends on 1)

The projector of claim 1, wherein the at least one projecting unit is capable of emitting red light, green light, and blue light.

### Claim 3 (depends on 1)

The projector of claim 1, wherein the at least one projecting unit is capable of emitting infra-red light.

### Claim 4 (depends on 1)

The projector of claim 1, wherein the at least one projecting unit includes a plurality of light-emitting diodes.

### Claim 5 (depends on 1)

The projector of claim 1, further comprising mechanical attachments for attaching the projector to or within a ceiling.

### Claim 6 (depends on 1)

The projector of claim 1, further comprising mechanical attachments for attaching the projector into a can light receptacle.

### Claim 7 (depends on 1)

The projector of claim 1, further comprising:
optics positioned to project the visible image.

### Claim 8 (depends on 7)

The projector of claim 7, wherein the optics are also positioned to project the non-visible image.

### Claim 9 (depends on 8)

The projector of claim 8, wherein the optics includes a portion that directs at least a portion of a reflected version of the non-visible image towards the camera.

### Claim 10 (depends on 9)

The projector of claim 9, wherein the processing module is capable of determining how the moving object interacts with the visible image by deriving depth information about a distance of the moving object from a location to which the visible image is projected from the image signals.

### Claim 11

A method for projecting an image comprising:
projecting a visible image;
projecting a non-visible image, the non-visible image comprising a pattern superimposed with the visible image;
receiving at least a portion of a reflected portion of the pattern of the non-visible image;
from at least the portion of the reflected portion of the pattern of the non-visible image, determining how the one or more objects interact with the visible image as the one or more objects move over the visible image.

### Claim 12 (depends on 11)

The method of claim 11, wherein determining how the one or more objects interact with the visible image as the one or more objects move over the visible image comprises deriving depth information regarding a distance of the one or more objects over the visible image based on at least the portion of the reflected portion of the pattern of the non-visible image.

### Claim 13

An interactive projector, comprising:
a housing capable of coupling with a light receptacle;
a projector carried by the housing;
a camera carried by the housing; and
a processing module carried by the housing, the processing module capable of receiving image signals from the camera and of determining how the moving object interacts with the visible image by processing the image signals.

### Claim 14 (depends on 13)

The interactive projector of claim 13, wherein the housing is capable of coupling with a can light receptacle.

### Claim 15 (depends on 13)

The interactive projector of claim 13, wherein the projector is capable of projecting a visible image and a non-visible image in superimposed relation.

### Claim 16 (depends on 13)

The interactive projector of claim 13, wherein the non-visible image comprises a pattern.

### Claim 17 (depends on 15)

The interactive projector of claim 15, wherein the camera is capable of capturing at least a portion of a reflected version of the non-visible image, including a portion of the non-visible image reflected by an object moving over the visible image.

### Claim 18 (depends on 17)

The interactive projector of claim 17, wherein the processing module is capable of receiving image signals from the camera and of determining how the moving object interacts with the visible image by processing the image signals.

### Claim 19 (depends on 13)

The interactive projector of claim 13, further comprising:
optics carried by the housing.

### Claim 20 (depends on 19)

The interactive projector of claim 19, wherein the optics are shared by the projector and the camera.
