# US 12,183,046 B2 · Partial access metadata for video-based point cloud compression data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,183,046 B2
- Document ID: US12183046B2
- Status: Granted
- Kind: B2
- Application number: 18/412,921
- Filed: 2024-01-15
- Published: 2024-05-09
- Granted: 2024-12-31
- Earliest claimed: 2020-03-16
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Youngkwon Lim
- Web page: https://patentgrep.com/patent/US12183046B2

## CPC

- G06T 9/001: {Model-based coding, e.g. wire frame}
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06V 20/64: Three-dimensional [3D] objects
- G06V 30/1437: {Sensor details, e.g. position, configuration or special lenses (G06V30/1429 takes precedence)}
- G06V 30/147: {Determination of region of interest}
- H04L 65/61: for supporting one-way streaming services, e.g. Internet radio
- H04L 65/70: Media network packetisation
- H04L 65/764: {at the destination (reformatting of additional data in video clients H04N21/4355)}
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 21/42202: {environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes}
- H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
- H04N 21/816: {involving special video data, e.g 3D video}
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- H04N 21/85406: {involving a specific file format, e.g. MP4 format}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A decoding device, method, and computer readable medium for partial access metadata for video-based point cloud compression data are disclosed. The decoding device for point cloud decoding includes a communication interface and a processor operably coupled to the communication interface. The communication interface receives a compressed bitstream and metadata related to the compressed bitstream. The processor identifies, in the metadata, region information that indicates a region of a point cloud based on a user perspective; locates a track of the compressed bitstream that corresponds to the region information; identifies, in the track, objects corresponding to the region of the point cloud; and decodes for display of an object, included in the objects identified in the track, that is visible from the user perspective.

## Claims

### Claim 1

A decoding device for generating partial access metadata for video-based point cloud compression, the decoding device comprising:
a communication interface configured to receive a compressed bitstream and metadata related to the compressed bitstream;
a processor operably coupled to the communication interface, wherein the processor is configured to:
identify, in the metadata, region information that indicates a region of a point cloud based on a user perspective;
determine whether an object corresponding to the region of the point cloud is visible from the user perspective based on a supplemental enhancement information (SEI) message included in the compressed bitstream;
in response to a determination that the object is visible from the user perspective:
locate a track of the compressed bitstream that corresponds to the region information;
identify, in the track, the object; and
decode the compressed bitstream to display the object from the user perspective.

### Claim 2 (depends on 1)

The decoding device of claim 1, wherein the user perspective includes information that indicates a user's location and viewing direction.

### Claim 3 (depends on 1)

The decoding device of claim 1, wherein the object is defined in the SEI message based on a length of an object identifier and a value of object identifiers.

### Claim 4 (depends on 3)

The decoding device of claim 3, wherein to determine whether the object is visible from the user perspective based on the SEI message, the processor is configured to determine whether the object is visible from the user perspective based on the value of the object identifier.

### Claim 5 (depends on 1)

The decoding device of claim 1, wherein the processor is further configured to:
identify, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;
identify a new object in the updated track that is visible from the user perspective; and
decode the compressed bitstream to display the new object from the user perspective.

### Claim 6 (depends on 1)

The decoding device of claim 1, wherein the processor is further configured to:
identify, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;
identify, in the track, a deleted object corresponding an object currently displayed; and
remove the deleted object from display.

### Claim 7 (depends on 6)

The decoding device of claim 6, wherein the deleted object is defined in the SEI message based on a length of an object identifier and a value of the object identifier.

### Claim 8

A method for point cloud decoding, the method comprising:
receiving, using a communication interface, a compressed bitstream and metadata related to the compressed bitstream;
identifying, using a processor operably coupled to the communication interface, region information in the metadata that indicates a region of a point cloud based on a user perspective;
determine whether an object corresponding to the region of the point cloud is visible from the user perspective based on a supplemental enhancement information (SEI) message included in the compressed bitstream;
in response to a determination that the object is visible from the user perspective:
locating a track of the compressed bitstream that corresponds to the region information;
identifying, in the track, the object; and
decoding the compressed bitstream to display the object from the user perspective.

### Claim 9 (depends on 8)

The method of claim 8, wherein the user perspective includes information that indicates a user's location and viewing direction.

### Claim 10 (depends on 8)

The method of claim 8, wherein the object is defined in the SEI message based on a length of an object identifier and a value of object identifiers.

### Claim 11 (depends on 10)

The method of claim 10, wherein determining whether the object is visible from the user perspective based on the SEI message comprises determining whether the object is visible from the user perspective based on the value of the object identifier.

### Claim 12 (depends on 8)

The method of claim 8, further comprising:
identifying, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;
identifying a new object in the updated track that is visible from the user perspective; and
decoding the compressed bitstream to display the new object from the user perspective.

### Claim 13 (depends on 8)

The method of claim 8, further comprising:
identifying, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;
identifying, in the track, a deleted object corresponding an object currently displayed; and
removing the deleted object from display.

### Claim 14 (depends on 13)

The method of claim 13, wherein the deleted object is defined in the SEI message based on a length of an object identifier and a value of the object identifier.

### Claim 15

A non-transitory computer readable medium embodying a computer program, the computer program comprising computer readable program code that, when executed by a processor of an electronic device, causes the electronic device to:
receive a compressed bitstream and metadata related to the compressed bitstream;
identify, in the metadata, region information that indicates a region of a point cloud based on a user perspective;
determine whether an object corresponding to the region of the point cloud is visible from the user perspective based on a supplemental enhancement information (SEI) message included in the compressed bitstream;
in response to a determination that the object is visible from the user perspective:
locate a track of the compressed bitstream that corresponds to the region information;
identify, in the track, the object; and
decode the compressed bitstream to display the object from the user perspective.

### Claim 16 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the user perspective includes information that indicates a user's location and viewing direction.

### Claim 17 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the object is defined in the SEI message based on a length of an object identifier and a value of object identifiers.

### Claim 18 (depends on 17)

The non-transitory computer readable medium of claim 17, wherein the computer readable program code that when executed when executed by the processor of the electronic device, causes the electronic device to determine whether the object is visible from the user perspective based on the SEI message comprises computer readable program code that when executed when executed by the processor of the electronic device, causes the electronic device to determine whether the object is visible from the user perspective based on the value of the object identifier.

### Claim 19 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the computer readable program code, when executed by the processor of the electronic device, further causes the electronic device to:
identify, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;
identify a new object in the updated track that is visible from the user perspective; and
decode the compressed bitstream to display the new object from the user perspective.

### Claim 20 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the computer readable program code, when executed by the processor of the electronic device, further causes the electronic device to:
identify, in the metadata, dynamic region information that indicates an updated track corresponding to the region information;
identify, in the track, a deleted object corresponding an object currently displayed; and
remove the deleted object from display.