# US 2021/0173340 A1 · Real-World Object Holographic Transport and Communication Room System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0173340 A1
- Document ID: US20210173340A1
- Status: Published application
- Kind: A1
- Application number: 17/175,679
- Filed: 2021-02-14
- Published: 2021-06-10
- Earliest claimed: 2018-10-31
- Assignees: Doubleme, Inc.
- Applicants: Doubleme, Inc
- Inventors: Heekwan KIM
- Web page: https://patentgrep.com/patent/US20210173340A1

## CPC

- G03H 1/0248: {Volume holograms}
- G06F 40/221: Parsing markup language streams (streaming G06F40/149)
- G03H 1/08: Synthesising holograms, {i.e. holograms synthesized from objects or objects from holograms}(using electric digital computers G06F; G06T)
- G03H 1/2249: {Holobject properties}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 13/194: Transmission of image signals
- G03H 2001/0833: {Look up table}
- G03H 2001/2271: {RGB holobject}
- G06T 2219/024: Multi-user, collaborative environment
- H04N 2013/0088: {Synthesising a monoscopic image signal from stereoscopic images, e.g. synthesising a panoramic or high resolution monoscopic image}
- G03H: HOLOGRAPHIC PROCESSES OR APPARATUS (holograms, e.g. point holograms, used as ordinary optical elements G02B5/32; producing stereoscopic or other three-dimensional effects G02B30/00; diffraction-grating systems G02B27/44; systems using moiré fringes G02B27/60; optical logic elements G02F3/00; stereo-photography G03B35/00; photosensitive materials or processes for photographic purposes G03C; {stereo-photographic or similar processes G03C9/00}; apparatus for processing exposed photographic materials G03D; analogue computers performing mathematical operations with the aid of optical elements G06E3/00; authentication by radiation, of concealed information carried by holograms or diffraction gratings G06K19/16; holographic storage G11B7/0065, G11C13/04; {stereoscopic or other three dimensional effects in television systems H04N13/00})
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A novel holographic transport and communication room system utilizes a single red-green-blue (RGB)-depth (RGB-D) camera to capture the motion of a dynamic target, which is required to rotate around the RGB-D camera, instead of capturing three-dimensional volume of the dynamic target conventionally with a plurality of multi-angle cameras positioned around the dynamic target. The captured 3D volume of the dynamic target subject undergoes relighting, subject depth calculations, geometrical extrapolations, and volumetric reconstructions in a machine-learning graphical transformation feedback loop to synthesize a refined real-time hologram. The resulting hologram in one holographic room system is shared with other users occupying other holographic room systems equipped with similar holographic capabilities for live bilateral or multilateral holographic visualization and collaboration. Preferably, each holographic room system also integrates a mixed-reality content synthesis table for real-time remote participant collaboration in manipulating holographic contents and a one-to-one ratio life-size holographic display and capture tubular device.

## Claims

### Claim 1

A real-world object holographic transport and communication room system comprising:
a holographic transport and communication room with a vertical wall;
a hologram bilateral monitoring device mounted on the vertical wall;
a single red-green-blue (RGB)-depth (RGB-D) camera installed near the hologram bilateral monitoring device, wherein the single RGB-D camera captures real-time z-axis depth parameters of a target object, in addition to conventional RGB color data;
the target object standing and self-rotating 360-degrees at least once in front of the single RGB-D camera to enable the single RGB-D camera to capture three-dimensional (3D) volume information of the target object over a specified duration;
a graphics server receiving a continuous stream of the 3D volume information of the target object over the specified duration while the target object is self-rotating 360-degrees at least once in front of the single RGB-D camera, wherein the specified duration of the continuous stream of the 3D volume information provides sufficient time-variable volumetric information of the target object to create, sharpen, and display a computerized hologram of the target object by the graphics server in a real-time bilateral holographic communication with a remote user outside the holographic transport and communication room;
a mixed-reality (MR) headset worn by a local user located inside the holographic transport and communication room;
a remote hologram from the remote user projected in the holographic transport and communication room, wherein the remote hologram from the remote user is visible through the MR headset worn by the local user inside the holographic transport and communication room; and
an autostereoscopic holographic display and capture tubular device that does not require a separate headset gear to visualize the remote hologram for other local users in the holographic transport and communication room.

### Claim 2 (depends on 1)

The real-world object holographic transport and communication room system of claim 1, further comprising a mixed-reality (MR) content synthesis table configured to superimpose a holographic mixed-reality (HMR) environment on top of the MR content synthesis table's surface, wherein the HMR environment invites multiple local and remote user participations from various holographic transport and communication rooms around the world to collaborate on a creation of a bilateral or multilateral holographic content in real time, with changes made to the bilateral or multilateral holographic content being reflected on top of the MR content synthesis table's surface in real time.

### Claim 3 (depends on 1)

The real-world object holographic transport and communication room system of claim 1, further comprising a holographic visualization table to place the autostereoscopic holographic display and capture tubular device on top of the holographic visualization table's surface.

### Claim 4 (depends on 1)

The real-world object holographic transport and communication room system of claim 1, wherein the autostereoscopic holographic display and capture tubular device is a 1-to-1 ratio life-size autostereoscopic tube that provides the remote hologram in undistorted original dimensions without miniaturization or magnification.

### Claim 5 (depends on 1)

The real-world object holographic transport and communication room system of claim 1, wherein the computerized hologram of the target object is created and dynamically sharpened over the specified duration, when the 3D volume information of the target object undergoes computerized graphical transformations involving relighting, subject depth calculations, geometrical extrapolations, and volumetric reconstructions through machine learning by the graphical server while the target object is self-rotating 360-degrees at least once in front of the single RGB-D camera.

### Claim 6 (depends on 5)

The real-world object holographic transport and communication room system of claim 5, wherein the computerized hologram of the target object, which is created and dynamically sharpened while the target object is self-rotating 360-degrees at least once in front of the single RGB-D camera, incorporates a time variable as a fourth dimension to generate a 4-dimensional (4D) hologram, wherein first three dimensions are related to the 3D volume information of the target object at a particular time slice, and wherein the fourth dimension encodes changes or movements of the 3D volume information over the specified duration.

### Claim 7 (depends on 1)

The real-world object holographic transport and communication room system of claim 1, wherein the hologram bilateral monitoring device mounted on the vertical wall displays both the computerized hologram of the target object located in the holographic transport and communication room and the remote hologram from the remote user.

### Claim 8 (depends on 1)

The real-world object holographic transport and communication room system of claim 1, wherein the remote user is located inside a second holographic transport and communication room with a second hologram bilateral monitoring device, a second single RGB-D camera, and a second target object, which is transformed into the remote hologram by the graphics server when transported to the local user located inside the holographic transport and communication room.

### Claim 9 (depends on 8)

The real-world object holographic transport and communication room system of claim 8, wherein the holographic transport and communication room and the second holographic transport and communication room are operatively connected by a 5G network, CAT 6 Ethernet cabling, 600 GHz wireless routers, or a combination thereof that supports high-throughput graphics data transmissions over remote distances.

### Claim 10 (depends on 8)

The real-world object holographic transport and communication room system of claim 8, wherein each holographic transport and communication room is standardized in dimensions and equipment as a single-cell model unit for scalable and convenient replications of holographic transport and communication room networks around the world.
