# US 12,217,354 B2 · File format for point cloud data > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,217,354 B2 - Document ID: US12217354B2 - Status: Granted - Kind: B2 - Application number: 17/704,781 - Filed: 2022-03-25 - Published: 2022-07-07 - Granted: 2025-02-04 - Earliest claimed: 2019-09-30 - Assignees: Zte Corporation - Applicants: ZTE Corporation - Inventors: Cheng Huang - Web page: https://patentgrep.com/patent/US12217354B2 ## CPC - G06T 15/08: Volume rendering - H04N 19/597: specially adapted for multi-view video sequence encoding - G06T 7/11: Region-based segmentation - G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI] - G06T 2207/10028: Range image; Depth image; 3D point clouds - G06T 2210/12: Bounding box - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A method of point cloud data processing includes determining a 3D region of a point cloud data and a 2D region of a point cloud track patch frame onto which one or more points of the point cloud data are projected; and reconstructing, based on patch frame data of the a point cloud track included in the 2D region and video frame data of corresponding point cloud component tracks, the 3D region of the point cloud data. ## Claims ### Claim 1 A method of point cloud data processing, comprising: determining a 3D region of a point cloud data; determining a 2D region of a point cloud track patch frame, wherein one or more points in the point cloud data of the 3D region are projected into the 2D region, wherein the 2D region is generated based on at least one of the following division principles: 1) defining the 2D region based on a patch position on the point cloud track patch frame 2) defining the 2D region based on a tile position on the point cloud track patch frame or 3) defining the 2D region based on a tile group position on the point cloud track patch frame; identifying a first box in the point cloud track according to a specific box type, wherein the first box indicates that the 2D region contains patch data for reconstructing the 3D region of the point cloud data; identifying a second box in the point cloud track according to the specific box type, wherein the second box indicates that the 2D region contains 2D tile data of the 3D region of the point cloud data; and reconstructing, from patch frame data included in the 2D region and video frame data of corresponding point cloud component tracks, the 3D region of the point cloud data. ### Claim 2 (depends on 1) The method according to claim 1, wherein the 3D region of the point cloud data and the 2D region of the point cloud track patch frame onto which one or more points of the 3D region are projected are determined based on an element in a point cloud track sample entry or a sample. ### Claim 3 (depends on 1) The method according to claim 1, wherein the determining comprises: determining the 3D region of the point cloud data based on elements in a timed metadata track, the timed metadata track containing a specific track reference to the point cloud track patch frame. ### Claim 4 (depends on 3) The method according to claim 3, comprising: identifying the timed metadata track according to a specific sample entry type, the timed metadata track indicating that the 2D region contains one of the following information for reconstructing the 3D region of the point cloud data: patch data, 2D tile data, tile group data. ### Claim 5 (depends on 1) The method according to claim 1, wherein information for the 3D region of the point cloud data includes: 3D bounding box parameters, including: a x, y, z coordinate offset of the 3D region, and/or a width, a height, and a depth of the 3D region. ### Claim 6 (depends on 1) The method according to claim 1, wherein information for the 2D region of the point cloud track patch frame includes: 2D bounding box parameters, including: x, y coordinate offset of the 2D region, and/or a width, and a height of the 2D region; a description information of patches, or a 2D tile information. ### Claim 7 A method of point cloud data processing, comprising: determining a 3D region of a point cloud data; determining a point cloud component track group corresponding to the 3D region; identifying a first box in the point cloud component track according to a specific track group type, the first box indicating the 3D region of the point cloud data corresponding to the point cloud component track group; wherein, the first box of point data component tracks corresponding to the same 3D region of the point cloud data have the same track group identity; and reconstructing, based on video frame data from point cloud component tracks in the point cloud component track group and corresponding point cloud track patch frame data, the 3D region of the point cloud data, wherein the video frame data comprises at least one of 1) decoded geometry video frames, 2) decoded attribute video frames, 3) decoded occupancy map video frames, 4) a block to patch mapping information or 5) a frame index in output order. ### Claim 8 (depends on 7) The method according to claim 7, wherein the determining the 3D region comprises: determining the 3D region of the point cloud data and the point cloud component track group corresponding to the 3D region based on an element in the track group data box of a point cloud component track; wherein the point cloud component track group includes: an occupancy map track, a geometry track, or an attribute track. ### Claim 9 (depends on 7) The method according to claim 7, wherein the determining comprises: determining the 3D region of the point cloud data and the point cloud component track group corresponding to the 3D region based on elements in a timed metadata track; the timed metadata track containing a specific track reference to the point cloud component track group. ### Claim 10 (depends on 9) The method of claim 9, comprising: identifying the timed metadata track according to a specific sample entry type, the timed metadata track indicating the 3D region of the point cloud data corresponding to the point cloud component track group. ### Claim 11 (depends on 7) The method according to claim 7, wherein information for the 3D region of the point cloud data includes: 3D bounding box parameters, including: a x, y, z coordinate offset of the 3D region, and/or a width, a height, and a depth of the 3D region. ### Claim 12 A video processing apparatus comprising a processor configured to implement a method of point cloud data processing, comprising: determining a 3D region of a point cloud data; determining a 2D region of a point cloud track patch frame onto which, wherein one or more points in the point cloud data of the 3D region are projected into the 2d region, wherein the 2D region is generated based on at least one of the following division principles: 1) defining the 2D region based on a patch position on the point cloud track patch frame 2) defining the 2D region based on a tile position on the point cloud track patch frame or 3) defining the 2D region based on a tile group position on the point cloud track patch frame; identifying a first box in the point cloud track according to a specific box type, wherein the first box indicates that the 2D region contains patch data for reconstructing the 3D region of the point cloud data; identifying a second box in the point cloud track according to the specific box type, wherein the second box indicates that the 2D region contains 2D tile data of the 3D region of the point cloud data; and reconstructing, from patch frame data included in the 2D region and video frame data of corresponding point cloud component tracks, the 3D region of the point cloud data. ### Claim 13 (depends on 12) The video processing apparatus according to claim 12, wherein the 3D region of the point cloud data and the 2D region of the point cloud track patch frame onto which one or more points of the 3D region are projected are determined based on an element in a point cloud track sample entry or a sample. ### Claim 14 (depends on 12) The video processing apparatus of claim 12, wherein the determining comprises: determining the 3D region of the point cloud data based on elements in a timed metadata track; the timed metadata track containing a specific track reference to the point cloud track patch frame. ### Claim 15 (depends on 14) The video processing apparatus of claim 14, wherein the processor is further configured for: identifying the timed metadata track according to a specific sample entry type, the timed metadata track indicating that the 2D region contains one of the following information for reconstructing the 3D region of the point cloud data: patch data, 2D tile data, tile group data. ### Claim 16 (depends on 12) The video processing apparatus according to claim 12, wherein information for the 3D region of the point cloud data includes: 3D bounding box parameters, including: a x, y, z coordinate offset of the 3D region, and/or a width, a height, and a depth of the 3D region. ### Claim 17 (depends on 12) The video processing apparatus according to claim 12, wherein information for the 2D region of the point cloud track patch frame includes: 2D bounding box parameters, including: x, y coordinate offset of the 2D region, and/or a width, and a height of the 2D region; a description information of patches, or a 2D tile information.