# US 2017/0255023 A1 · Display system based on hologram and hologram display method using the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0255023 A1
- Document ID: US20170255023A1
- Status: Published application
- Kind: A1
- Application number: 15/363,582
- Filed: 2016-11-29
- Published: 2017-09-07
- Earliest claimed: 2016-03-02
- Assignees: Gwangju Institute of Science and Technology
- Applicants: Gwangju Institute of Science and Technology
- Inventors: Yong Yi LEE; Kwan Heng LEE; Moon Gu SON; Bilal Ahmed; Jong Hun LEE
- Web page: https://patentgrep.com/patent/US20170255023A1

## CPC

- G02B 30/56: by projecting aerial or floating images
- G02B 5/32: Holograms used as optical elements
- G02B 27/108: {for sampling a portion of a beam or combining a small beam in a larger one, e.g. wherein the area ratio or power ratio of the divided beams significantly differs from unity, without spectral selectivity}
- G06T 7/85: {Stereo camera calibration}
- H04N 9/3185: {Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14)}
- H04N 9/3194: {including sensor feedback}
- H04N 13/327: Calibration thereof
- H04N 13/388: Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present disclosure relates to a holographic display system including: a projection object having a three-dimensional shape corresponding to an original item; an image projection unit comprising projectors projecting unit images of parts selected from a three-dimensional image of the original item on the projection object; and a reflector disposed adjacent to the projection object and reflecting images reflected from the projection object to provide an augmented three-dimensional holographic image. In the disclosure, the unit images corresponding to a three-dimensional image of an original item are projected on the projection object having a three-dimensional shape corresponding to the original item using the projectors and reflected by the projection object and augmented by the reflector, thereby providing a virtual image having three dimensional information corresponding to the original item, whereby a proper image is provided to an observer even when the viewpoint of the observer is changed.

## Claims

### Claim 1

A holographic display system, comprising:
a projection object having a three-dimensional shape corresponding to an original item;
an image projection unit comprising a plurality of projectors projecting unit images of parts of selected from a three-dimensional image of the original item on the projection object; and
a reflector disposed adjacent to the projection object and reflecting images reflected from the projection object to provide an augmented three-dimensional holographic image.

### Claim 2 (depends on 1)

The holographic display system according to claim 1, further comprising:
a skew prevention unit controlling the image projection unit to prevent the unit images projected on the projection object by the projectors from being skewed.

### Claim 3 (depends on 2)

The holographic display system according to claim 2, wherein the skew prevention unit comprises: a plurality of cameras disposed adjacent to the respective projectors and capturing the unit images projected on the projection object by the respective projectors; and a controller controlling the projectors and the cameras to prevent the unit images projected on the projection object from being skewed based on image information obtained by the cameras.

### Claim 4 (depends on 3)

The holographic display system according to claim 3, wherein the skew prevention unit further comprises an image guide unit guiding the cameras for the cameras to capture images of the unit images projected on the projection object, as seen from the viewpoint of the respective projectors.

### Claim 5 (depends on 4)

The holographic display system according to claim 4, wherein the image guide unit comprises a plurality of beam splitters provided to each of the projectors and transmitting output light emitted from the projector to the projection object and reflecting fractions of light reflected by the projection object which are incident toward the projector in a direction parallel to an optical axis of the output light toward the cameras.

### Claim 6

A hologram display method, comprising:
photographing a three-dimensional image corresponding to an original item;
fabricating a projection object having a three-dimensional shape corresponding to the original item;
installing a plurality of projectors to project unit images of parts of selected from the three-dimensional image corresponding to the original item on the projection object;
installing cameras to capture the unit images projected on the projection object by the projectors;
setting the projectors and the cameras to prevent the unit images emitted from the projectors from being skewed;
installing a reflector adjacent to the projection object to reflect images reflected by the projection object to provide an augmented holographic image; and
displaying the holographic image by projecting the unit images on the projection object through the projectors.

### Claim 7 (depends on 6)

The hologram display method according to claim 6, wherein setting the projectors and the cameras comprises:
calibrating the projectors and the cameras;
calculating a pixel correspondence between the images projected by the projectors and the images captured by the cameras;
estimating three-dimensional geometry information of a projection surface as seen from the viewpoint of the projectors based on calibration information of the projectors and the cameras obtained in the step of calibrating the projectors and the cameras and information on the pixel correspondence between the images projected by the projector and the images captured by the cameras and obtained in the step of calculating the pixel correspondence; and
estimating a posture of the three-dimensional image based on the three-dimensional geometry information obtained in the step of estimating three-dimensional geometry information.

### Claim 8 (depends on 7)

The hologram display method according to claim 7, wherein calibrating the projectors and the cameras comprises:
projecting a setting image having a predetermined pattern on a setting plate having a predetermined pattern through the projectors, followed by photographing the setting image using the cameras;
acquiring calibration information for calibrating the projectors and the cameras based on the setting image and image information obtained by capturing the setting image projected on the setting plate; and
calibrating the projectors and the cameras based on the calibration information to complete setting.

### Claim 9 (depends on 8)

The hologram display method according to claim 8, wherein a projection surface of the setting plate on which the setting image is projected from the projectors has a checkered pattern.

### Claim 10 (depends on 7)

The hologram display method according to claim 7, wherein photographing a setting image includes sequentially varying the setting position of the setting plate to various postures and projecting setting images having different patterns on the setting plate according to the setting position.

### Claim 11 (depends on 8)

The hologram display method according to claim 8, wherein photographing a setting image includes sequentially varying the setting position of the setting plate to various postures and projecting setting images having different patterns on the setting plate according to the setting position.

### Claim 12 (depends on 7)

The hologram display method according to claim 7, wherein calculating a pixel correspondence comprises:
projecting a sample image on the projection object through the projectors, followed by capturing an image of the projection object with the sample image projected thereon using the cameras; and
calculating information on a pixel correspondence between images projected on the projection object by the projectors and images of the projection object captured by the cameras through comparison of the sample image with the images captured by the cameras.

### Claim 13 (depends on 12)

The hologram display method according to claim 12, wherein the sample image has a pattern in which multiple black unit patterns extending in one of longitudinal and transverse directions of the projection object are arranged at a distance from one another in the other direction of the projection object.

### Claim 14 (depends on 12)

The hologram display method according to claim 12, wherein calculating a pixel correspondence further comprises: virtually reconstructing images of the projection object, as seen from the viewpoint of the projectors, based on the images captured by the cameras using the information on the pixel correspondence between the images projected on the projection object and the images captured by the cameras obtained in the step of calculating the information on the pixel correspondence.

### Claim 15 (depends on 13)

The hologram display method according to claim 13, wherein calculating a pixel correspondence further comprises: virtually reconstructing images of the projection object, as seen from the viewpoint of the projectors, based on the images captured by the cameras using the information on the pixel correspondence between the images projected on the projection object and the images captured by the cameras obtained in the step of calculating the information on the pixel correspondence.

### Claim 16 (depends on 6)

The hologram display method according to claim 6, wherein installing the cameras comprises:
primarily installing the cameras adjacent to the respective projectors; and
secondarily installing an image guide unit guiding the cameras for the cameras to capture images of the unit images projected on the projection object, as seen from the viewpoint of the projectors, on each of the projectors and the cameras.

### Claim 17 (depends on 16)

The hologram display method according to claim 16, wherein the image guide unit comprises a plurality of beam splitters provided to each of the projectors and transmitting output light emitted from the projector to the projection object and reflecting fractions of light reflected by the projection object which are incident toward the projector in a direction parallel to an optical axis of the output light toward the camera.

### Claim 18 (depends on 7)

The hologram display method according to claim 7, wherein displaying the holographic image comprises:
setting partial images of the three-dimensional image corresponding to projection areas of the projection object covered by the respective projectors as the unit images; and
projecting the unit images on the projection object using the respective projectors.
