3d gaussian splatting data compression
AssigneesSony Group Corporation, Sony Corporation of America
InventorsShashank Nelamangala Sridhara, Alexandre Zaghetto, Danillo Graziosi, Ali Tabatabai
Life of this patent
Estimating the term…
Loading patent…
AssigneesSony Group Corporation, Sony Corporation of America
InventorsShashank Nelamangala Sridhara, Alexandre Zaghetto, Danillo Graziosi, Ali Tabatabai
Estimating the term…
Post training compression of 3DGS data is agnostic to training in a traditional signal compression perspective. Gaussian parameters are treated as signals. Pre-processing and transform coding techniques are used to compress the signals effectively. Firstly, lossless/lossy compression is performed on 3DGS geometry (positions, scales, rotations) using a point cloud coding-based (e.g., G-PCC, GeS) framework. Positions are compressed using occupancy tree coding. Scales and rotations are encoded as attributes using transform coding. The widely used block-based graph Fourier transform (GFT) is used to compress the attributes (base colors, spherical harmonic coefficients and opacities). In addition, a graph construction strategy is used for 3DGS data that computes the edge weights based on similarity (or dissimilarity) between the 3D Gaussian distributions using KL-divergence. Alternatively, positions can be encoded using occupancy tree (e.g., G-PCC, GeS) or AI-based PCC methods, and any subset of Gaussian parameters or the transformed coefficients of Gaussian parameters can be mapped into 2D frames and encoded by video coders.
A method programmed in a non-transitory memory of a device comprising:
An apparatus comprising:
A system comprising:
A method programmed in a non-transitory memory of a device comprising:
Dependencies are inferred from the claim text.