# US 9,521,276 B2 · Portable projection capture device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,521,276 B2
- Document ID: US9521276B2
- Status: Granted
- Kind: B2
- Application number: 14/233,893
- Filed: 2011-09-29
- Published: 2014-06-26
- Granted: 2016-12-13
- Earliest claimed: 2011-08-02
- Assignees: Hewlett-Packard Development Company, L.P.
- Applicants: David Bradley Short; Geoffrey C Mayne
- Inventors: David Bradley Short; Geoffrey C Mayne
- Web page: https://patentgrep.com/patent/US9521276B2

## CPC

- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G03B 15/00: Special procedures for taking photographs; Apparatus therefor
- G03B 15/05: Combinations of cameras with electronic flash apparatus; Electronic flash units
- G03B 17/54: with projector
- G03B 21/28: Reflectors in projection beam {(in illumination beam G03B21/2066)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/03545: {Pens or stylus}
- G06F 3/042: by opto-electronic means
- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- H04N 1/00267: {with a viewing or projecting apparatus, e.g. for reading image information from a film (H04N1/00262 takes precedence)}
- H04N 1/0044: {for image preview or review, e.g. to help the user position a sheet}
- H04N 1/00493: {Particular location of the interface or console}
- H04N 1/00496: {Constructional details of the interface or console not otherwise provided for, e.g. rotating or tilting means}
- H04N 1/00562: {Supporting the apparatus as a whole, e.g. stands}
- H04N 1/02815: {Means for illuminating the original, not specific to a particular type of pick-up head}
- H04N 1/19594: {using a television camera or a still video camera}
- H04N 9/3111: {for displaying the colours sequentially, e.g. by using sequentially activated light sources (sequential projection in colour photography G03B33/08)}
- H04N 23/20: for generating image signals from infrared radiation only
- H04N 23/51: Housings
- H04N 23/56: provided with illuminating means
- G03B 5/02: Lateral adjustment of lens
- G03B 21/147: {Optical correction of image distortions, e.g. keystone}
- G03B 21/2033: {LED or laser light sources}
- G03B 27/323: {Copying cameras (G03B27/34 - G03B27/70 take precedence)}
- G03B 33/06: by additive-colour projection apparatus
- G03B 2215/0567: Solid-state light source, e.g. LED, laser
- H04N 2201/0089: Image display device
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In one example, a portable projection capture device includes a digital camera and a projector mounted below the camera. The camera defines a capture area on a work surface within which the camera is configured to capture still and video images. The projector defines a display area on the work surface overlapping the capture area. The projector is configured to project into the capture area both images captured by the camera and white light for illuminating real objects in the capture area for camera image capture.

## Claims

### Claim 1

A projection capture device comprising:
a camera supported by a base over a flat, horizontal work surface, the camera defining a three dimensional capture space bounded in two dimensions by a capture area on the work surface within which a camera sensor included in the camera is to capture visible light of images focused on the camera sensor by a shift lens included in the camera that shifts the visible light of still and video images in a Y-direction relative to the camera sensor, wherein the camera is positioned in a Z-direction over the capture area at a location offset in at least the Y-direction from a center of the capture area with the camera sensor facing the capture area;
a projector supported by the base below the camera, the projector defining a three dimensional display space bounded in two dimensions by a display area on the work surface overlapping at least part of the capture area; and
a controller supported by the base to: with the projector, illuminate objects in the capture space; with the camera, capture visible light of images of objects in the capture space illuminated by the projector; and, with the projector, project visible light representative of the images of the objects captured by the camera into the display space;
a mirror positioned in the Z-direction over the capture space, and wherein the camera is placed in front of the mirror so that it does not block the projector's light path.

### Claim 2 (depends on 1)

The device of claim 1, further comprising a housing having a first part housing the camera over the base and a second part housing the projector and the controller on the base.

### Claim 3 (depends on 2)

The device of claim 2, further comprising a mirror housed together with the camera in the first part of the housing, the projector and the mirror positioned with respect to one another such that light from the projector reflected off the mirror illuminates the capture space.

### Claim 4 (depends on 1)

The device of claim 1, wherein the projector is to project white light of at least 200 lumens into the capture area with red, green and blue light emitting diodes (LEDs) synchronized with a video frame rate of the camera.

### Claim 5 (depends on 4)

The device of claim 4, wherein a refresh rate of the projector and a refresh period of each LED sub-frame is an integral number of an exposure time of the camera for each captured frame.

### Claim 6 (depends on 1)

The device of claim 1, wherein the projector is positioned below the camera outside a volume bounded in two dimensions by the display area.

### Claim 7 (depends on 6)

The device of claim 6, wherein the projector is to project light into the display area along a light path that is longer than a height of the camera above the work surface.

### Claim 8 (depends on 1)

The device of claim 1, wherein the camera and the projector are operatively connected to one another through the controller to project a graphical user interface into the display space.

### Claim 9 (depends on 1)

The device of claim 1, further comprising an electronic display housed together with the controller, the projector and the camera, the display operatively connected to the controller to display an image captured by the camera.

### Claim 10 (depends on 1)

The device of claim 1 further comprising a user input device operatively connected to the controller to enable a user to interact with the device in the display space.

### Claim 11 (depends on 10)

The device of claim 10, wherein the user input device includes an infrared digital stylus and an infrared camera housed together with the controller, the projector, and the camera for capturing infrared light emitted by the stylus in a capture space of the infrared camera that is coincident with the display space.

### Claim 12 (depends on 11)

The device of claim 11, wherein the infrared camera is integrated into the light path of the projector light such that a field-of-view of the projector and a field-of-view of the infrared camera are coincident.