# US 2018/0324396 A1 · Projection system, image processing apparatus, projection method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0324396 A1
- Document ID: US20180324396A1
- Status: Published application
- Kind: A1
- Application number: 16/032,383
- Filed: 2018-07-11
- Published: 2018-11-08
- Earliest claimed: 2016-01-13
- Assignees: Ricoh Company, Ltd.
- Inventors: Masaaki ISHIKAWA; Yukinaka Uchiyama
- Web page: https://patentgrep.com/patent/US20180324396A1

## CPC

- H04N 9/3147: {Multi-projection systems (video walls G06F3/1446)}
- G03B 21/00: Projectors or projection-type viewers; Accessories therefor (devices for changing pictures G03B23/00)
- G03B 21/14: Details
- G03B 21/60: characterised by the nature of the surface
- G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T)
- H04N 5/74: Projection arrangements for image reproduction, e.g. using eidophor
- H04N 9/3185: {Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14)}
- H04N 9/3188: {Scale or resolution adjustment (scaling in general G06T3/40; resolution modifying circuits for displays in general G09G5/391)}
- H04N 9/3194: {including sensor feedback}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A projection system for projecting an image onto a projection body having a curve in one direction by projection units includes processors and memory, which upon execution, causes the projection system to extract a set of grid points indicating distortion of a projected image from captured calibration images; to convert each set of grid points of a target projection unit commonly extracted from captured calibration images having a calibration pattern projected on the projection body in different imaging ranges in association with the one direction onto a common coordinate system; to combine the converted sets of grid points on the common coordinate system in accordance with position; and to calculate a correction coefficient based on the combined sets of grid points.

## Claims

### Claim 1

A projection system for projecting an image by one or more projection units onto a projection body having a curve in one direction, the projection system comprising:
one or more processors;
a memory storing instructions that, when executed by the one or more processors, cause the projection system to:
extract a set of grid points indicating distortion of a projected image from each of a plurality of captured calibration images prepared;
convert each set of grid points of a target projection unit commonly extracted from a selected plurality of captured calibration images selected from among the plurality of captured calibration images onto a common coordinate system, the selected plurality of captured calibration images having a calibration pattern projected on the projection body captured in different imaging ranges in association with the one direction;
combine a plurality of the converted sets of grid points of the target projection unit on the common coordinate system in accordance with position by calculating coordinate values with respect to a grid point corresponding to a single projection area projected by the target projection unit alone by blending coordinate values of the plurality of sets of grid points in accordance with position; and
calculate a correction coefficient based on the combined sets of grid points.

### Claim 2 (depends on 1)

The projection system according to claim 1, wherein
the different imaging ranges in which the selected plurality of captured calibration images are captured indicate respective imaging ranges within which the calibration pattern projected on the projection body is imaged at positions shifted along a direction substantially perpendicular to the one direction in which the projection body has the curve.

### Claim 3 (depends on 1)

The projection system according to claim 1, wherein
the plurality of captured calibration images further include an adjacent-projection-unit-captured calibration image having the calibration pattern projected on the projection body by an adjacent projection unit adjacent to the target projection unit, and wherein
in a case where the target projection unit has the adjacent projection unit on one side thereof along a direction substantially perpendicular to the one direction having the curve in arrangement of projected images and has no adjacent projection unit on the other side thereof, the processors further cause the projection system to:
distinguish between grid points of the target projection unit corresponding to the single projection area not superimposed in a projection range of the adjacent projection unit and grid points of the target unit superimposed in the projection range of the adjacent projection unit, among the grid points of the target projection unit; and
calculate coordinate values with respect to the grid points of the target projection unit superimposed in the projection range of the adjacent projection unit, using coordinate values of a converted set of grid points of the target projection unit based on one of the selected plurality of captured calibration images that is imaged substantially in a same imaging range as an imaging range of the adjacent-projection-unit-captured calibration image.

### Claim 4 (depends on 1)

The projection system according to claim 1, wherein the processors further cause the projection system to:
extract an alignment point of the projected image from each of the plurality of captured calibration images; and
convert the commonly extracted each set of grid points of the target projection unit onto the common coordinate system, based on the alignment point extracted from a corresponding one of the plurality of captured calibration images.

### Claim 5 (depends on 1)

The projection system according to claim 1, wherein the processors further cause the projection system to:
prepare a captured scale image obtained by imaging a physical scale fixed to a surface of the projection body and extending in substantially a same direction as the one direction in which the projection body has the curve, such that the imaged physical scale is positioned in substantially a center of an imaging range; and
perform coordinate correction in the one direction based on the captured scale image.

### Claim 6 (depends on 1)

The projection system according to claim 1, wherein the processors further cause the projection system to:
cause one of or both of a projection device and an imaging device to obtain a captured calibration image, the projection device indicating each of the projection units.

### Claim 7 (depends on 1)

The projection system according to claim 1, wherein the processors further cause the projection system to:
calculate coordinates of a grid point to be extrapolated in a first direction being curved by a quadratic or higher-order function form, based on coordinates of a plurality of grid points arranged in the first direction selected from among the plurality of extracted grid points;
calculate coordinates of a grid point to be extrapolated in a second direction differing from the first direction, based on coordinates of a plurality of grid points arranged in the second direction selected from among the plurality of extracted grid points; and
calculate a correction coefficient with respect to an image projected from each of the one or more projection units based on the extracted grid points and the extrapolated grid points.

### Claim 8

An image processing apparatus for projecting an image onto a projection body having a curve in one direction by one or more projection units, the image processing apparatus comprising:
one or more processors;
a memory storing instructions that, when executed by the one or more processors, cause the image processing apparatus to:
extract a set of grid points indicating distortion of a projected image from each of a plurality of captured calibration images prepared;
convert each set of grid points of a target projection unit commonly extracted from a selected plurality of captured calibration images selected from among the plurality of captured calibration images onto a common coordinate system, the selected plurality of captured calibration images having a calibration pattern projected on the projection body captured in different imaging ranges in association with the one direction;
combine a plurality of the converted sets of grid points of the target projection unit on the common coordinate system in accordance with position by calculating coordinate values with respect to a grid point corresponding to a single projection area projected by the target projection unit alone by blending coordinate values of the plurality of sets of grid points in accordance with position; and
calculate a correction coefficient based on the combined sets of grid points.

### Claim 9

A computer-implemented projection method for projecting an image onto a projection body having a curve in one direction by one or more projection units, the computer-implemented projection method comprising:
preparing, by a computer device, a plurality of captured calibration images;
extracting, by a computer device, a set of grid points indicating distortion of a projected image from each of the plurality of captured calibration images prepared;
converting, by a computer device, each set of grid points of a target projection unit commonly extracted from a selected plurality of captured calibration images selected from among the plurality of captured calibration images onto a common coordinate system, the selected plurality of captured calibration images having a calibration pattern projected on the projection body captured in different imaging ranges in association with the one direction;
combining, by a computer device, a plurality of the converted sets of grid points of the target projection unit on the common coordinate system in accordance with position by calculating coordinate values with respect to a grid point corresponding to a single projection area projected by the target projection unit alone by blending coordinate values of the plurality of sets of grid points in accordance with position; and
calculating, by a computer device, a correction coefficient based on the combined sets of grid points.
