# US 12,183,044 B2 · Three-dimensional content processing methods and apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,183,044 B2 - Document ID: US12183044B2 - Status: Granted - Kind: B2 - Application number: 17/816,102 - Filed: 2022-07-29 - Published: 2022-11-17 - Granted: 2024-12-31 - Earliest claimed: 2020-06-24 - Assignees: Zte Corporation - Applicants: ZTE Corporation - Inventors: Yaxian Bai; Cheng Huang - Web page: https://patentgrep.com/patent/US12183044B2 ## CPC - G06T 9/001: {Model-based coding, e.g. wire frame} - H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) - H04N 19/1883: {the unit relating to sub-band structure, e.g. hierarchical level, directional tree, e.g. low-high [LH], high-low [HL], high-high [HH]} - H04N 19/33: in the spatial domain - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 21/234327: {by decomposing into layers, e.g. base layer and one or more enhancement layers} - H04N 21/2362: Generation or processing of Service Information [SI] - H04N 21/4345: {Extraction or processing of SI, e.g. extracting service information from an MPEG stream} - H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics} - H04N 21/816: {involving special video data, e.g 3D video} - H04N 21/85406: {involving a specific file format, e.g. MP4 format} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Methods, systems, and apparatus for processing of three-dimensional visual content are described. One example method of processing three-dimensional content includes parsing a level of detail (LoD) information of a bitstream containing three-dimensional (3D) content that is represented as one geometry sub-bitstream and one or more attribute sub-bitstreams; and generating, based on the LoD information, decoded information by decoding at least a portion of the geometry sub-bitstream and the one or more attribute sub-bitstreams corresponding to a desired level of detail; and reconstructing, using the decoded information, a three-dimensional scene corresponding at least to the desired level of detail. The bitstream conforms to a format organized according to multiple levels of details of the 3D content. ## Claims ### Claim 1 A method of processing three-dimensional content, comprising: parsing a level of detail (LoD) information of a bitstream containing three-dimensional (3D) content that is represented as one geometry sub-bitstream and one or more attribute sub-bitstreams, wherein the parsing the LoD information comprises identifying a first syntax structure in the bitstream that includes multiple levels of details; generating, based on the LoD information, decoded information by decoding at least a portion of the geometry sub-bitstream and the one or more attribute sub-bitstreams corresponding to a desired level of detail; reconstructing, using the decoded information, a three-dimensional scene corresponding at least to the desired level of detail, wherein the bitstream conforms to a format organized according to multiple levels of details of the 3D content; and using a sample entry type field in the bitstream for determining whether the bitstream supports a spatial scalability functionality and for the identifying the first syntax structure, wherein the first syntax structure of the bitstream with multiple levels of details comprises: a first structure in which a complete set of levels of the bitstream is carried in one track with sub-sample structure; a second structure that includes an extractor with each level of the bitstream in the one track; and a third structure that includes one or more levels of the bitstream in the one track with redundant data from lower levels. ### Claim 2 (depends on 1) The method of claim 1, wherein the parsing the LoD information comprises: determining whether the bitstream comprises spatial scalability sub-bitstreams; identifying the LoD information using a second syntax structure, a sub-sample structure, a sample entry or a descriptor; or locating content corresponding to the desired level of detail or the complete set of levels. ### Claim 3 (depends on 2) The method of claim 2, wherein the sub-sample structure comprises a codec_specific_parameters field extension representing the LoD information. ### Claim 4 (depends on 2) The method of claim 2, further comprising: identifying a value of a LoD of the bitstream using an LoD value in the sample entry. ### Claim 5 (depends on 1) The method of claim 1, further comprising: identifying one or more tracks containing sub-streams corresponding to complete levels of detail using a first track group type; and decoding data in the one or more tracks corresponding to complete levels of detail. ### Claim 6 (depends on 1) The method of claim 1, further comprising: decoding a portion of the bitstream corresponding to the desired levels of detail and one or more lower levels in a single track. ### Claim 7 (depends on 2) The method of claim 2, further comprising: using a LoD descriptor to determine whether an Adaptation Set supports the spatial scalability functionality; and identifying a LoD in the Adaptation Set using an LoD value in the LoD descriptor. ### Claim 8 (depends on 1) The method of claim 1, further comprising: decoding a portion of the bitstream corresponding to the desired LoD and one or more lower levels from a single Adaptation Set; or identifying and decoding a portion of the bitstream corresponding to the desired LoD in one Adaptation Set and data with lower levels in other Adaptation Sets. ### Claim 9 (depends on 1) The method of claim 1, further comprising: identifying one or more Adaptation Sets containing data corresponding to all levels of detail using a complete track id; and decoding complete data in one or more Adaptation Sets corresponding to complete levels of detail. ### Claim 10 (depends on 1) The method of claim 1, wherein a portion of the bitstream corresponding to the desired LoD includes data corresponding to the desired LoD with a single-track encapsulation, and wherein the single-track encapsulation comprises the one geometry sub-bitstream and the one or more attribute bitstreams that are encapsulated in a same track. ### Claim 11 (depends on 1) The method of claim 1, wherein a portion of the bitstream corresponding to the desired LoD includes data corresponding to the desired LoD with a multiple-track encapsulation, and wherein the multiple-track encapsulation comprises the one geometry sub-bitstream and the one or more attribute bitstreams that are encapsulated in separate tracks. ### Claim 12 (depends on 1) The method of claim 1, wherein the reconstructing the three-dimensional scene comprises: reconstructing a spatial position and one or more attribute values of each point in the 3D content; or reconstructing a spatial position and attribute values of each point in the 3D content and rendering 3D scenes according to a viewing position and a viewport of a user. ### Claim 13 An apparatus, comprising a processor configured to implement a method that causes the apparatus to: parse a level of detail (LoD) information of a bitstream containing three-dimensional (3D) content that is represented as one geometry sub-bitstream and one or more attribute sub-bitstreams, wherein the parsing the LoD information comprises identify a first syntax structure in the bitstream that includes multiple levels of details; generate, based on the LoD information, decoded information by decoding at least a portion of the geometry sub-bitstream and the one or more attribute sub-bitstreams corresponding to a desired level of detail; reconstruct, using the decoded information, a three-dimensional scene corresponding at least to the desired level of detail, wherein the bitstream conforms to a format organized according to multiple levels of details of the 3D content; and use a sample entry type field in the bitstream for a determination of whether the bitstream supports a spatial scalability functionality and for the identify the first syntax structure, wherein the first syntax structure of the bitstream with multiple levels of details comprises: a first structure in which a complete set of levels of the bitstream is carried in one track with sub-sample structure; a second structure that includes an extractor with each level of the bitstream in the one track; and a third structure that includes one or more levels of the bitstream in the one track with redundant data from lower levels. ### Claim 14 (depends on 13) The apparatus of claim 13, wherein the LoD information is parsed by the processor configured to: determine whether the bitstream comprises spatial scalability sub-bitstreams; identify the LoD information using a second syntax structure, a sub-sample structure, a sample entry or a descriptor; or locate content corresponding to the desired level of detail or the complete set of levels. ### Claim 15 (depends on 14) The apparatus of claim 14, wherein the sub-sample structure comprises a codec_specific_parameters field extension representing the LoD information. ### Claim 16 (depends on 14) The apparatus of claim 14, wherein the processor is further configured to: identify a value of a LoD of the bitstream using an LoD value in the sample entry. ### Claim 17 (depends on 14) The apparatus of claim 14, wherein the processor is further configured to: use a LoD descriptor to determine whether an Adaptation Set supports the spatial scalability functionality; and identify a LoD in the Adaptation Set using an LoD value in the LoD descriptor. ### Claim 18 (depends on 13) The apparatus of claim 13, wherein the processor is further configured to: identify one or more tracks containing sub-streams corresponding to complete levels of detail using a first track group type; and decode data in the one or more tracks corresponding to complete levels of detail. ### Claim 19 (depends on 13) The apparatus of claim 13, wherein the processor is further configured to: decode a portion of the bitstream corresponding to the desired levels of detail and one or more lower levels in a single track. ### Claim 20 (depends on 13) The apparatus of claim 13, wherein the processor is further configured to: decode a portion of the bitstream corresponding to the desired LoD and one or more lower levels from a single Adaptation Set; or identify and decoding a portion of the bitstream corresponding to the desired LoD in one Adaptation Set and data with lower levels in other Adaptation Sets. ### Claim 21 (depends on 13) The apparatus of claim 13, wherein the processor is further configured to: identify one or more Adaptation Sets containing data corresponding to all levels of detail using a complete track id; and decode complete data in one or more Adaptation Sets corresponding to complete levels of detail. ### Claim 22 (depends on 13) The apparatus of claim 13, wherein a portion of the bitstream corresponding to the desired LoD includes data corresponding to the desired LoD with a single-track encapsulation, and wherein the single-track encapsulation comprises the one geometry sub-bitstream and the one or more attribute bitstreams that are encapsulated in a same track. ### Claim 23 (depends on 13) The apparatus of claim 13, wherein a portion of the bitstream corresponding to the desired LoD includes data corresponding to the desired LoD with a multiple-track encapsulation, and wherein the multiple-track encapsulation comprises the one geometry sub-bitstream and the one or more attribute bitstreams that are encapsulated in separate tracks. ### Claim 24 (depends on 13) The apparatus of claim 13, wherein the three-dimensional scene is reconstructed by the processor configured to: reconstruct a spatial position and one or more attribute values of each point in the 3D content; or reconstruct a spatial position and attribute values of each point in the 3D content and render 3D scenes according to a viewing position and a viewport of a user.