# US 2021/0263468 A1 · Method for generating a digital hologram, associated device, holographic display system and computer program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0263468 A1
- Document ID: US20210263468A1
- Status: Published application
- Kind: A1
- Application number: 17/255,612
- Filed: 2019-05-28
- Published: 2021-08-26
- Earliest claimed: 2018-06-28
- Assignees: Fondation B-Com
- Applicants: Fondation B-Com
- Inventors: Antonin GILLES; Patrick GIOIA
- Web page: https://patentgrep.com/patent/US20210263468A1

## CPC

- G03H 1/0808: {Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific}
- G02B 27/0103: {comprising holographic elements}
- G02B 27/0172: {characterised by optical features}
- G03H 1/0005: {Adaptation of holography to specific applications (holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042)}
- H04N 13/366: using viewer tracking
- H04N 13/385: alternating rapidly the location of the left-right image components on the display screens (for viewing without the aid of special glasses using time variant parallax barriers H04N13/315; displays for viewing with the aid of special glasses or head-mounted displays using temporal multiplexing H04N13/341)
- G02B 2027/0109: {comprising details concerning the making of holograms}
- G02B 2027/0174: {holographic}
- G03H 2001/0088: {for video-holography, i.e. integrating hologram acquisition, transmission and display}
- G03H 2001/0825: {Numerical processing in hologram space, e.g. combination of the CGH [computer generated hologram] with a numerical optical element}
- G03H 2210/30: 3D object
- G03H 2210/452: into points
- G03H: HOLOGRAPHIC PROCESSES OR APPARATUS (holograms, e.g. point holograms, used as ordinary optical elements G02B5/32; producing stereoscopic or other three-dimensional effects G02B30/00; diffraction-grating systems G02B27/44; systems using moiré fringes G02B27/60; optical logic elements G02F3/00; stereo-photography G03B35/00; photosensitive materials or processes for photographic purposes G03C; {stereo-photographic or similar processes G03C9/00}; apparatus for processing exposed photographic materials G03D; analogue computers performing mathematical operations with the aid of optical elements G06E3/00; authentication by radiation, of concealed information carried by holograms or diffraction gratings G06K19/16; holographic storage G11B7/0065, G11C13/04; {stereoscopic or other three dimensional effects in television systems H04N13/00})
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed is a method for generating a digital hologram representing a 3D scene including an object, an object being defined by points and their associated intensity. For each object, a prior step of calculating an “omnidirectional” angular spectrum of the light field emitted by an object in the scene on the surface of a geometric solid centered on the object, a surface of the solid being sampled according to a predetermined grid, a sample of the grid being associated with a vector frequency; for the scene, the following steps: —obtaining a pose of an observer in the world frame of reference; —deriving the hologram from the scene as a function of the pose obtained from the “multidirectional” angular spectra calculated for each object. The step of calculating an angular spectrum of the light field for each object of the scene takes into account predetermined viewing directions.

## Claims

### Claim 1

A method for generating a digital hologram representative of a 3D scene, said scene comprising at least one object (Obi) defined by a set of points each point having an associated intensity, said method comprising:
for each said object (Obi), a preliminary step (E1) of calculating an “omnidirectional” angular spectrum (SAai) corresponding to a plane-wave decomposition of a light field emitted by the object at a surface of a geometric solid centered on said object, the surface of said solid being sampled according to a predetermined grid, wherein the calculating associates a sample (x,y,z) of the grid to a frequency vector (f=(fx,fy,fz)) and to an amplitude (Ai) corresponding to a sum of contributions to the light field of points of the object along a direction equal to that of the frequency vector;
for the scene, the following steps:
obtaining (E2) a pose (PU) of an observer (U);
deriving (E3) the hologram (H) of the scene as a function of the pose obtained from the “omnidirectional” angular spectra (SAi) calculated for each said object;
wherein the step (E1) of calculating the angular spectrum of the light field for each said object of the scene comprises, for a plurality of predetermined viewing directions, the following sub-steps:
for each said viewing direction (Vj):
determining (E11) a sub-set of the points of the object, comprising the non-occulted points; and
calculating (E12) an angular sub-spectrum of the light field emitted by the points of the determined sub-set; and
summing (E13) over the plurality of predetermined angular directions the amplitudes of the calculated angular sub-spectra, associated with a same sample of the grid.

### Claim 2 (depends on 1)

The method for generating a digital hologram according to claim 1, wherein the step of determining the sub-set of non-occulted points comprises the following sub-steps:
2D+Z rendering (E111) the object by projecting the points of the object along the viewing direction (Vj) and forming an intensity image and a depth map of the projected points; and
inversely projecting (E112) the points of the formed intensity image to points of the object in a reference frame of the object and calculating the coordinates thereof as a function of the depth map.

### Claim 3 (depends on 1)

The method for generating a digital hologram according to claim 1, wherein the step of calculating the angular sub-spectrum (E12) comprises a sub-step (E121) of determining an area of validity of the occultations associated with a viewing direction at the surface of the geometric solid and wherein the calculation (E122) of the sample amplitudes is performed for the samples comprised in said area of validity.

### Claim 4 (depends on 3)

The method for generating a digital hologram according to claim 3, wherein the samples comprised in the area of validity satisfy the following condition:
Vj,xx+Vj,yy+Vj,zz>0
where (x,y,z) denotes the position of the sample and (Vx, Vy, Vz) the viewing direction in a reference frame (Ri) of the object (Obi).

### Claim 5 (depends on 1)

The method for generating a digital hologram according to claim 1, wherein the geometric solid comprises a plurality of plane faces and wherein the predetermined grid is divided into a plurality of sub-grids forming a regular grid pattern, each of the sub-grids being associated with one of the plane faces of the solid.

### Claim 6 (depends on 5)

The method for generating a digital hologram according to claim 5, wherein the amplitude associated with a sample of the sub-grid associated with one of the faces of the solid, for the calculation of the angular sub-spectrum along a said viewing direction, is defined by the following formula:
A
i
,
j
⁡
(
x
,
y
,
z
)
=
∑
k
=
1
M
x
⁢
M
y
⁢
I
i
,
j
⁡
(
u
k
,
v
k
)
⁢
exp
⁡
(
-
j
⁢
2
⁢
π
λ
⁢
(
f
x
⁢
x
k
+
f
y
⁢
y
k
+
f
z
⁢
z
k
)
)
,
with Mx, My being the dimensions of the intensity and depth images, λ being the wavelength used, and
(
f
x
f
y
f
z
)
=
1
x
2
+
y
2
+
z
2
⁢
(
x
y
z
)
being the frequencies associated with the sample (x,y,z).

### Claim 7 (depends on 5)

The method for generating a digital hologram according to claim 5, wherein the geometric solid is a cube.

### Claim 8 (depends on 5)

The method for generating a digital hologram according to claim 5, wherein a number of the plurality of viewing directions is equal to a number of the faces.

### Claim 9 (depends on 1)

The method for generating a digital hologram according to claim 1, wherein the step of deriving the angular spectrum of the hologram of the scene comprises deriving the angular spectrum of a sub-hologram for each said object of the scene from the angular spectrum of said object, summing the angular spectra of the derived sub-holograms and applying (E32) an inverse Fourier transform to the derived angular spectrum to obtain the hologram (H).

### Claim 10 (depends on 9)

The method for generating a digital hologram according to claim 9, wherein the angular spectrum of the hologram is derived from the “omnidirectional” angular spectra (SAi) calculated for each said object (Obi) basis according to the following formula:
H
^
⁡
(
f
h
,
x
,
f
h
,
y
)
=
∑
i
=
1
N
⁢
SA
i
⁡
(
f
x
λ
⁢
F
,
f
y
λ
⁢
F
,
f
z
λ
⁢
F
)
⁢
exp
⁡
(
j
⁢
2
⁢
π
⁡
(
s
x
⁢
f
h
,
x
+
s
y
⁢
f
h
,
y
+
s
z
⁢
λ
-
2
-
f
h
,
x
2
-
f
h
,
y
2
)
)
,
where:
=(O; {right arrow over (xh)},{right arrow over (yh)},{right arrow over (zh)}) denotes a local reference frame of the hologram whose origin is located at the center of the hologram H, whose axes defined by {right arrow over (xh)} and {right arrow over (yh)} coincide with the horizontal and vertical axes of the hologram, respectively, and whose axis defined by {right arrow over (zh)} coincides with the optical axis of the hologram,
x
h
→
=
(
x
h
⁢
0
x
h
⁢
1
x
h
⁢
2
)
,
y
h
→
=
(
y
h
⁢
0
y
h
⁢
1
y
h
⁢
2
)
⁢
⁢
and
z
h
→
=
(
z
h
⁢
0
z
h
⁢
1
z
h
⁢
2
)
,
⁢
F
=
max
⁡
(
f
x
,
f
y
,
f
z
)
,
(
s
x
s
y
s
z
)
=
[
x
h
⁢
0
x
h
⁢
1
x
h
⁢
2
y
h
⁢
0
y
h
⁢
1
y
h
⁢
2
z
h
⁢
0
z
h
⁢
1
z
h
⁢
2
]
⁢
⁢
(
x
i
-
x
0
y
i
-
y
0
z
i
-
z
0
)
denotes the position of the center of the object Obi in the reference frame h, and
(
f
x
f
y
f
z
)
=
[
x
h
⁢
0
y
h
⁢
0
z
h
⁢
0
x
h
⁢
1
y
h
⁢
1
z
h
⁢
1
x
h
⁢
2
y
h
⁢
2
z
h
⁢
2
]
⁢
⁢
(
f
h
,
x
f
h
,
y
λ
-
2
-
f
h
,
x
2
-
f
h
,
y
2
)
denotes frequency coordinates of the angular spectrum of the hologram in the reference frame (Ri) of the object Obi.

### Claim 11

A device (100, 100′) for generating a digital hologram (H) representative of a 3D scene comprising at least one object (Obi), said device comprising a processor that is configured for:
For each object, calculating an “omnidirectional” angular spectrum corresponding to the plane-wave decomposition of the light field emitted by an object of the scene at the surface of a geometric solid centered on said object, a surface of said solid being sampled according to a predetermined grid, the calculation associating a sample of the grid to a frequency vector (f=(fx, fy, ft)) and to an amplitude corresponding to a sum of contributions to the light field of points of the object along a direction equal to that of the frequency vector;
For the scene:
Obtaining a pose (PU) of an observer (U);
Deriving the hologram (H) of the scene as a function of the pose obtained from the “omnidirectional” angular spectra (SAi) calculated on a per-object basis;
wherein the device is further configured for, during the calculation of an angular spectrum of the light field for each object of the scene, for a plurality of predetermined viewing directions:
for each viewing direction (Vj):
determining a sub-set of non-occulted points of the object;
calculating an angular sub-spectrum of the light field emitted by the points of the sub-set; and
summing over the plurality of predetermined angular directions the amplitudes of the calculated angular sub-spectra, associated with a same sample of the grid.

### Claim 12 (depends on 11)

A holographic rendering system (SRH, SRH′) comprising a module for obtaining a three-dimensional scene comprising at least one object, a module for obtaining an observer's pose, and a holographic screen (SLM) adapted to render a hologram, wherein the system further comprises the device (100, 100′) for generating the hologram according to claim 11.

### Claim 13 (depends on 12)

The holographic rendering system (SRH, SRH′) according to claim 12, further comprising a head-mounted display suitable for being worn near the eyes of the observer (U), said head-mounted display comprising a storage module (M1) adapted of to store the omnidirectional angular spectrum pre-calculated for the at least one object of the scene.

### Claim 14

(canceled)

### Claim 15 (depends on 1)

A non-transitory computer-readable recording medium, readable by a processor, on which is recorded a computer program comprising program code instructions for executing the steps of the method according to claim 1 when executed by the processor.

### Claim 16 (depends on 2)

The method for generating a digital hologram according to claim 2, wherein the step of calculating the angular sub-spectrum (E12) comprises a sub-step (E121) of determining an area of validity of the occultations associated with a viewing direction at the surface of the geometric solid and wherein the calculation (E122) of the sample amplitudes is performed for the samples comprised in said area.

### Claim 17 (depends on 2)

The method for generating a digital hologram according to claim 2, wherein the geometric solid comprises a plurality of plane faces and wherein the predetermined grid is cut into a plurality of sub-grids forming a regular grid pattern, a sub-grid being associated with a face of the solid.

### Claim 18 (depends on 3)

The method for generating a digital hologram according to claim 3, wherein the geometric solid comprises a plurality of plane faces and wherein the predetermined grid is cut into a plurality of sub-grids forming a regular grid pattern, a sub-grid being associated with a face of the solid.

### Claim 19 (depends on 4)

The method for generating a digital hologram according to claim 4, wherein the geometric solid comprises a plurality of plane faces and wherein the predetermined grid is cut into a plurality of sub-grids forming a regular grid pattern, a sub-grid being associated with a face of the solid.

### Claim 20 (depends on 6)

The method for generating a digital hologram according to claim 6, wherein the geometric solid is a cube.

### Claim 21 (depends on 6)

The method for generating a digital hologram according to claim 6, wherein the plurality of viewing directions comprises as many directions as the solid has faces.
