# US 2019/0318488 A1 · 3d point cloud compression systems for delivery and access of a subset of a compressed 3d point cloud

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318488 A1
- Document ID: US20190318488A1
- Status: Published application
- Kind: A1
- Application number: 16/379,675
- Filed: 2019-04-09
- Published: 2019-10-17
- Earliest claimed: 2018-04-12
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Youngkwon Lim; Imed Bouazizi; Eric Ho Ching Yip; Rajan Laxman Joshi
- Web page: https://patentgrep.com/patent/US20190318488A1

## CPC

- G06T 7/337: {involving reference images or patches}
- H04N 21/816: {involving special video data, e.g 3D video}
- G06T 7/38: Registration of image sequences
- G06V 20/647: {by matching two-dimensional images to three-dimensional objects}
- H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference
- H04N 19/172: the region being a picture, frame or field
- H04N 19/182: the unit being a pixel
- H04N 21/23412: {for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects}
- H04N 21/44012: {involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs}
- H04N 21/85406: {involving a specific file format, e.g. MP4 format}
- H04N 21/8547: involving timestamps for synchronizing content
- H04N 19/597: specially adapted for multi-view video sequence encoding
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An encoding device, a decoding device and a method for point cloud encoding is provided. The method includes generating, for a 3D point cloud, frames corresponding to attributes of the 3D point cloud and an occupancy map. The method also includes encoding, the frames to generate one or more bitstreams. The one or more bitstreams include individual tracks and media content. The individual tracks include media tracks and a timed metadata track. The timed metadata track references the media tracks and the media tracks correspond respectively to the attributes. The method also includes generating a container including the one or more bitstreams transmitting the container.

## Claims

### Claim 1

A decoding device for point cloud decoding, comprising:
a communication interface configured to receive a container including one or more bitstreams; and
a processor operably coupled to the communication interface, wherein the processor is configured to:
identify, from the container, individual tracks including a timed metadata track and media tracks, wherein the timed metadata track references the media tracks and the media tracks correspond respectively to attributes of a three-dimensional (3D) point cloud,
decode the one or more bitstreams to generate frames based on the individual tracks and media content, wherein the frames correspond to the attributes and an occupancy map, and
generate the 3D point cloud using the frames and the timed metadata track.

### Claim 2 (depends on 1)

The decoding device of claim 1, wherein:
the processor is configured to identify a point cloud compression header in a sample entry of the timed metadata track, and
the timed metadata track indicates a location of at least one of the occupancy map or an auxiliary patch within the media content.

### Claim 3 (depends on 1)

The decoding device of claim 1, wherein the processor is further configured to:
identify correspondence information associated with the individual tracks,
determine that the 3D point cloud is segmented into multiple subsets,
wherein the correspondence information associates points of the 3D point cloud to pixels included in the of frames.

### Claim 4 (depends on 3)

The decoding device of claim 3, wherein:
the pixels included in the frames include a first subset and a second subset, the first subset representing a higher level of detail than the second subset,
the communication interface is configured to receive the correspondence information prior to receiving the container
the processor is further configured to:
decode the first subset and the second subset, based on the correspondence information, and
generate the 3D point cloud using the frames and the timed metadata track corresponding to the first subset and the second subset.

### Claim 5 (depends on 3)

The decoding device of claim 3, wherein:
the multiple subsets span the 3D point cloud,
a point, of the 3D point cloud, that is within a first subset, of the multiple subsets, is not within another subset of the multiple subsets, and
the multiple subsets correspond respectively to multiple 3D spatial regions.

### Claim 6 (depends on 5)

The decoding device of claim 5, wherein the multiple 3D spatial regions are cuboids.

### Claim 7 (depends on 5)

The decoding device of claim 5, wherein the pixels included in the frames are motion constrained tiles.

### Claim 8

An encoding device for point cloud encoding, comprising:
a processor configured to:
generate, for a three-dimensional (3D) point cloud, frames corresponding to attributes of the 3D point cloud and an occupancy map;
encode, the frames to generate one or more bitstreams including individual tracks and media content, the individual tracks include media tracks and a timed metadata track, wherein the timed metadata track references the media tracks and the media tracks correspond respectively to the attributes;
generate a container including the one or more bitstreams; and
a communication interface operably coupled to the processor, the communication interface configured to transmit the container.

### Claim 9 (depends on 8)

The encoding device of claim 8, wherein:
the processor is configured to place a point cloud compression header in a sample entry of the timed metadata track, and
the timed metadata track indicates a location of at least one of the occupancy map or an auxiliary patch within the media content.

### Claim 10 (depends on 8)

The encoding device of claim 8, wherein the processor is configured to:
segment the 3D point cloud into multiple subsets;
generate correspondence information associating points of the 3D point cloud to pixels included in the frames; and
include the correspondence information in the individual tracks.

### Claim 11 (depends on 10)

The encoding device of claim 10, wherein:
the pixels included in the frames include a first subset and a second subset, the first subset representing a higher level of detail than the second subset, and
the communication interface is configured to transmit the correspondence information, associated with the first subset and the second subset, prior to transmitting the container.

### Claim 12 (depends on 10)

The encoding device of claim 10, wherein:
the multiple subsets span the 3D point cloud,
a point, of the 3D point cloud, that is within a first subset, of the multiple subsets, is not within another subset of the multiple subsets, and
the multiple subsets correspond respectively to multiple 3D spatial regions.

### Claim 13 (depends on 12)

The encoding device of claim 12 wherein the multiple 3D spatial regions are cuboids.

### Claim 14 (depends on 12)

The encoding device of claim 12, wherein the pixels included in the frames are motion constrained tiles.

### Claim 15

A method for point cloud encoding, comprising:
generating, for a three-dimensional (3D) point cloud, frames corresponding to attributes of the 3D point cloud and an occupancy map;
encoding, the frames to generate one or more bitstreams including individual tracks and media content, the individual tracks include media tracks and a timed metadata track, wherein the timed metadata track references the media tracks and the media tracks correspond respectively to the attributes;
generating a container including the one or more bitstreams; and
transmitting the container.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
placing a point cloud compression header in a sample entry of the timed metadata track, and
wherein the timed metadata track indicates a location of at least one of the occupancy map or an auxiliary patch within the media content.

### Claim 17 (depends on 15)

The method of claim 15, further comprising:
segmenting the 3D point cloud into multiple subsets;
generating correspondence information associating points of the 3D point cloud to pixels included in the frames; and
including the correspondence information in the individual tracks.

### Claim 18 (depends on 17)

The method of claim 17, wherein:
the pixels included in the frames include a first subset and a second subset, the first subset representing a higher level of detail than the second subset, and
the method further comprises transmitting the correspondence information, associated with the first subset and the second subset, prior to transmitting the container.

### Claim 19 (depends on 17)

The method of claim 17, wherein:
the multiple subsets span the 3D point cloud,
a point, of the 3D point cloud, that is within a first subset, of the multiple subsets, is not within another subset of the multiple subsets, and
the multiple subsets correspond respectively to multiple 3D spatial regions.

### Claim 20 (depends on 19)

The method of claim 19, wherein:
the multiple 3D spatial regions are cuboids, and
the pixels included in the frames are motion constrained tiles.