Decorrelation of spherical harmonic coefficients towards efficient compression of 3D Gaussian splats
AssigneesSony Group Corporation, Sony Corporation of America
InventorsShashank Nelamangala Sridhara, Alexandre Zaghetto, Danillo Graziosi, Ali Tabatabai
Life of this patent
Estimating the term…
Abstract
Techniques to handle the Spherical Harmonic (SH) coefficients associated with 3DGS towards effective compression are described herein. SH coefficients are used to represent view dependent RGB color values, which takes a significant amount of memory—48 out of 59 parameters per Gaussian. By applying suitable transformation to SH coefficients, the inter-channel redundancies are exploited, thereby effectively reducing the memory requirements by 50%.
Claims21
A method comprising:
- applying a color space transform to Spherical Harmonic (SH) coefficients of a Gaussian splat;
- calculating view-dependent YUV components using the transformed SH coefficients;
- and
- eliminating redundant SH coefficients, wherein eliminating the redundant SH coefficients includes retaining base colors, retaining the SH coefficients for the Luma (Y) component, but eliminating the SH coefficients for the Chroma (U and V) component.
An apparatus comprising:
- a non-transitory memory for storing an application, the application for:
- applying a color space transform to Spherical Harmonic (SH) coefficients of a Gaussian splat;
- calculating view-dependent YUV components using the transformed SH coefficients;
- and
- eliminating redundant SH coefficients, wherein eliminating the redundant SH coefficients includes retaining base colors, retaining the SH coefficients for the Luma (Y) component, but eliminating the SH coefficients for the Chroma (U and V) component;
- and
- a processor coupled to the memory, the processor configured for processing the application.
A system comprising:
- a first device configured for acquiring the Gaussian splat;
- and
- a second device configured for:
- receiving the Gaussian splat from the first device;
- applying a color space transform to Spherical Harmonic (SH) coefficients of a Gaussian splat;
- calculating view-dependent YUV components using the transformed SH coefficients;
- and
- eliminating redundant SH coefficients, wherein eliminating the redundant SH coefficients includes retaining base colors, retaining the SH coefficients for the Luma (Y) component, but eliminating the SH coefficients for the Chroma (U and V) component.
A system comprising:
- a first device configured for acquiring the Gaussian splat;
- and
- a second device configured for:
- receiving the Gaussian splat from the first device;
- applying a color space transform to Spherical Harmonic (SH) coefficients of a Gaussian splat;
- calculating view-dependent YUV components using the transformed SH coefficients;
- and
- eliminating redundant SH coefficients, wherein eliminating the redundant SH coefficients reduces 48 SH coefficients to 18 SH coefficients.
Dependencies are inferred from the claim text.