# US 2020/0272277 A1 · Projector, image display system, and method for controlling image display system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0272277 A1
- Document ID: US20200272277A1
- Status: Published application
- Kind: A1
- Application number: 16/798,910
- Filed: 2020-02-24
- Published: 2020-08-27
- Earliest claimed: 2019-02-25
- Assignees: Seiko Epson Corporation
- Applicants: Seiko Epson Corporation
- Inventors: Hiroki SENSHIKI
- Web page: https://patentgrep.com/patent/US20200272277A1

## CPC

- H04N 9/3185: {Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14)}
- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- G06T 11/60: Creating or editing images; Combining images with text
- H04N 9/3194: {including sensor feedback}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A projector includes an image projection section projecting an image on a projection surface, an imager capturing a surface image to produce a captured image, a controller causing the image projection section to project a calibration image and causing the imager to capture the projected calibration image, a computing section calculating conversion information for converting a position in the captured image into a position in the projection image based on the captured image as a result of the calibration image imaging, and a detector searching the projection image and detecting a pointing position at which a light emitting pen pointing at the projection surface has pointed based on the conversion information and captured image as a result of the light emitting pen imaging, and the computing section calculates a projection distance between the projector and projection surface based on the captured image as a result of the calibration image imaging.

## Claims

### Claim 1

A projector that detects a pointing position at which a pointing element has pointed, the projector comprising:
a projection section that projects a projection image on a projection surface;
an imager that captures an image of the projection surface to produce a captured image;
a controller that causes the projection section to project a calibration image as the projection image and causes the imager to capture an image of the projected calibration image;
a computing section that calculates conversion information for converting a position in the captured image into a position in the projection image based on the captured image produced when the imager captures an image of the calibration image; and
a detector that detects the pointing position in the projection image based on the captured image produced when the imager captures an image of the pointing element that points at the projection surface and the conversion information calculated by the computing section,
wherein the computing section calculates a projection distance that is a distance between the projector and the projection surface based on the captured image produced when the imager captures an image of the calibration image.

### Claim 2 (depends on 1)

The projector according to claim 1,
wherein the detector corrects the detected pointing position by using the calculated projection distance.

### Claim 3 (depends on 2)

The projector according to claim 2, further comprising:
a drawing section that produces a drawn image based on a trajectory of the pointing position corrected by the detector using the projection distance; and
a combiner that combines the drawn image produced by the drawing section with the projection image.

### Claim 4

An image display system that detects a pointing position at which a pointing element has pointed, the image display system comprising:
a projection section that projects a projection image on a projection surface;
an imager that captures an image of the projection surface to produce a captured image;
a controller that causes the projection section to project a calibration image as the projection image and causes the imager to capture an image of the projected calibration image;
a computing section that calculates conversion information for converting a position in the captured image into a position in the projection image based on the captured image produced when the imager captures an image of the calibration image; and
a detector that detects the pointing position in the projection image based on the captured image produced when the imager captures an image of the pointing element that points at the projection surface and the conversion information calculated by the computing section,
wherein the computing section calculates a projection distance that is a distance between the projection section and the projection surface based on the captured image produced when the imager captures an image of the calibration image.

### Claim 5 (depends on 4)

The image display system according to claim 4,
wherein the detector corrects the detected pointing position by using the calculated projection distance.

### Claim 6 (depends on 5)

The image display system according to claim 5, further comprising:
a drawing section that produces a drawn image based on a trajectory of the pointing position corrected by the detector using the projection distance; and
a combiner that combines the drawn image produced by the drawing section with the projection image.

### Claim 7

A method for controlling an image display system that includes a projection section that projects a projection image on a projection surface and an imager that captures an image of the projection surface to produce a captured image and detects a pointing position at which a pointing element that points at the projection surface has pointed, the method comprising:
causing the projection section to project a calibration image as the projection image;
causing the imager to capture an image of the projected calibration image;
calculating conversion information for converting a position in the captured image into a position in the projection image based on the captured image produced when the imager captures an image of the calibration image;
detecting the pointing position in the projection image based on the captured image produced when the imager captures an image of the pointing element that points at the projection surface and the calculated conversion information; and
calculating a projection distance that is a distance between the projection section and the projection surface based on the captured image produced when the imager captures an image of the calibration image.

### Claim 8 (depends on 7)

The method for controlling an image display system according to claim 7,
wherein the detected pointing position is corrected by using the calculated projection distance.

### Claim 9 (depends on 8)

The method for controlling an image display system according to claim 8, further comprising:
producing a drawn image based on a trajectory of the pointing position corrected by using the projection distance; and
combining the produced drawn image with the projection image.
