# US 12,182,932 B2 · Information processing device, information processing method, and information processing program for specifying object light in stepwise manner and wave modifying

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,182,932 B2
- Document ID: US12182932B2
- Status: Granted
- Kind: B2
- Application number: 17/795,424
- Filed: 2021-03-05
- Published: 2023-03-23
- Granted: 2024-12-31
- Earliest claimed: 2020-03-13
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Masato Akao
- Web page: https://patentgrep.com/patent/US12182932B2

## CPC

- G06T 15/40: Hidden part removal
- G03H 1/08: Synthesising holograms, {i.e. holograms synthesized from objects or objects from holograms}(using electric digital computers G06F; G06T)
- G06T 15/50: Lighting effects
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G03H: HOLOGRAPHIC PROCESSES OR APPARATUS (holograms, e.g. point holograms, used as ordinary optical elements G02B5/32; producing stereoscopic or other three-dimensional effects G02B30/00; diffraction-grating systems G02B27/44; systems using moiré fringes G02B27/60; optical logic elements G02F3/00; stereo-photography G03B35/00; photosensitive materials or processes for photographic purposes G03C; {stereo-photographic or similar processes G03C9/00}; apparatus for processing exposed photographic materials G03D; analogue computers performing mathematical operations with the aid of optical elements G06E3/00; authentication by radiation, of concealed information carried by holograms or diffraction gratings G06K19/16; holographic storage G11B7/0065, G11C13/04; {stereoscopic or other three dimensional effects in television systems H04N13/00})

## Abstract

An information processing device (20) includes: a specifying unit (23A) that specifies, from a plurality of pieces of layer data capable of expressing object light of a three-dimensional object in a stepwise manner, an occlusion region that is lost due to a foreground image of layer data of another hierarchy; and a modifying unit (23B) that modifies at least one of an amplitude or a phase in layer data at a boundary with the occlusion region that has been specified so that leakage of the object light to the outside of the occlusion region is suppressed.

## Claims

### Claim 1

An information processing device comprising:
circuitry configured to
specify an occlusion region from a plurality of pieces of layer data capable of expressing object light of a three-dimensional object in a stepwise manner, wherein
the plurality of pieces of layer data includes background layer data and foreground layer data representing a background image and a foreground image respectively, and
the occlusion region is a partial region of the background layer data corresponding to the foreground image, and
extend an amplitude of the background layer data toward an inside of the occlusion region to fill a boundary of the occlusion region,
wherein the extension of the amplitude of the background layer data includes:
shrinking the background layer data;
extending an amplitude of the shrunk background layer data toward the inside of the occlusion region; and
enlarging the shrunk background layer data having the extended amplitude to restore a reduced size of the background layer data due to the shrinking.

### Claim 2 (depends on 1)

The information processing device according to claim 1,
wherein the circuitry is further configured to smooth the amplitude of the background layer data corresponding to a vicinity of the boundary of the occlusion region in a case where an amplitude distribution corresponding to the vicinity of the boundary of the occlusion region is flat.

### Claim 3 (depends on 1)

The information processing device according to claim 1,
wherein the circuitry is further configured to:
determine whether the occlusion region includes at least one of self-occlusion or mutual occlusion, wherein
the self-occlusion is caused among parts of a single object, and
the mutual occlusion is caused among a plurality of objects; and
modify the amplitude of the background layer data corresponding to the vicinity of the boundary of the occlusion region by:
projecting the foreground layer data onto the occlusion region in accordance with determination that the occlusion region includes the self-occlusion; and
extending the amplitude of the background layer data toward the inside of the occlusion region in accordance with the determination that the occlusion region includes the mutual occlusion.

### Claim 4

An information processing device comprising:
circuitry configured to
specify an occlusion region from a plurality of pieces of layer data capable of expressing object light of a three-dimensional object in a stepwise manner, wherein
the plurality of pieces of layer data includes background layer data and foreground layer data representing a background image and a foreground image respectively, and
the occlusion region is a partial region of the background layer data corresponding to the foreground image, and
modify a phase of the background layer data corresponding to a boundary of the occlusion region to prevent a wavefront propagated from the boundary of the occlusion region from spreading into the occlusion region.

### Claim 5 (depends on 4)

The information processing device according to claim 4,
wherein the circuitry is further configured to modify the phase of the background layer data to have a random phase to diffuse the wavefront.

### Claim 6

An information processing device comprising:
circuitry configured to
specify an occlusion region from a plurality of pieces of layer data capable of expressing object light of a three-dimensional object in a stepwise manner, wherein
the plurality of pieces of layer data includes background layer data and foreground layer data representing a background image and a foreground image respectively, and
the occlusion region is a partial region of the background layer data corresponding to the foreground image, and
extend an amplitude of the background layer data toward an inside of the occlusion region to fill a boundary of the occlusion region,
wherein the circuitry is further configured to:
generate the plurality of pieces of layer data indicating the object light;
calculate wavefront propagation on a basis of an amplitude and a phase of the plurality of pieces of layer data; and
generate interference fringes on a basis of a calculation result of the wavefront propagation.

### Claim 7

An information processing method comprising:
acquiring a plurality of pieces of layer data capable of expressing object light of a three-dimensional object in a stepwise manner, wherein the plurality of pieces of layer data includes background layer data and foreground layer data representing a background image and a foreground image respectively;
specifying an occlusion region from the plurality of pieces of layer data, wherein the occlusion region is a partial region of the background layer data corresponding to the foreground image; and
extending an amplitude of the background layer data toward an inside of the occlusion region to fill a boundary of the occlusion region;
wherein extending the amplitude of the background layer data includes:
shrinking the background layer data;
extending an amplitude of the shrunk background layer data toward the inside of the occlusion region; and
enlarging the shrunk background layer data having the extended amplitude to restore a reduced size of the background layer data due to the shrinking.