US 2026/0253318 A1Published application

Dynamic culling of gaussian splats using level of precision

OwnerShuja KHALID, Keyi LIU +4inventors

InventorsShuja KHALID, Keyi LIU, Shufang LU, Yehor POLSCHCHA, Mohamed Ibrahim Hafez IBRAHIM, Yang LIU

Life of this patent

Estimating the term…

Loading patent…

Abstract

The methods, devices, and systems to support the adaptive real-time post-processing culling technique to balance between rendering quality and performance are disclosed. In one embodiment the device uses hard thresholds for opacity and granularity assessment in its dynamic culling component to execute the performance mode when all Gaussians attributes with values that are less than the hard thresholds are culled. In another embodiment, the device uses both hard and soft thresholds for opacity and granularity in the dynamic culling component to execute the balanced mode uses hard ( τ h o ⁢ p ⁢ a ⁢ c ⁢ i ⁢ t ⁢ y , τ h g ⁢ r ⁢ a ⁢ n ⁢ ularity ) and soft ( τ s opacity , τ s g ⁢ r ⁢ a ⁢ n ⁢ ularity ) thresholds. All Gaussian ellipsoids that are less than the hard thresholds are culled immediately. All remaining Gaussians below the soft threshold are quantized in the quantization component and rendered in the rendering component. The resulting image may have better quality than just culling.

Claims20

Dependent claims

A method for dynamic culling of gaussians to render a scene, the method comprising, by a device:

receiving a first plurality of gaussians representing the scene, each gaussian of the first plurality being associated with a respective first parameter and a respective second parameter;
receiving a first threshold value and a second threshold value;
receiving a request to render the scene;
initiating a discovery operation to discover at least one gaussian of the first plurality, a value of a first parameter of the at least one gaussian is less than the first threshold value and a value of a second parameter of the at least one gaussian is less than the second threshold value;
in response to determining that the discovery operation to discover the at least one gaussian was successful, culling the at least one gaussian;
generating a second plurality of gaussians, the second plurality of gaussians being based at least in part on the first plurality of gaussians, each gaussian of the second plurality of gaussians being associated with a respective first parameter and a respective second parameter, and a value of the respective first parameter is equal to or greater than the first threshold value, or a value of the respective second parameter is equal to or greater than the second threshold value, or both;
and generating a rendered image of the scene using the second plurality of gaussians.

4 more elements

A method for dynamic culling of gaussians to render a scene, the method comprising, by a device:

receiving a first plurality of gaussians representing the scene, each gaussian of the first plurality being associated with a respective first parameter and a respective second parameter;
receiving a first threshold value and a second threshold value;
receiving a third threshold value and a fourth threshold value;
receiving a request to render the scene;
initiating a discovery operation to discover at least one gaussian of the first plurality, a value of a first parameter of the at least one gaussian is less than the first threshold value and a value of a second parameter of the at least one gaussian is less than the second threshold value;
in response to determining that the discovery operation to discover the at least one gaussian was successful, culling the at least one gaussian;
generating a second plurality of gaussians, the second plurality of gaussians being based at least in part on the first plurality of gaussians, each gaussian of the second plurality of gaussians being associated with a respective first parameter and a respective second parameter, and a value of the respective first parameter is equal to or greater than the first threshold value, or a value of the respective second parameter is equal to or greater than the second threshold value, or both;
generating a third plurality of gaussians, the third plurality of gaussians being based at least in part on the second plurality of gaussians, each gaussian of the third plurality of gaussians being associated with a respective first parameter and a respective second parameter, and a value of the respective first parameter is equal to or greater than the third threshold value, or a value of the respective second parameter is equal to or greater than the fourth threshold value, or both;
generating a fourth plurality of gaussians, the fourth plurality of gaussians being based at least in part on the second plurality of gaussians, each gaussian of the fourth plurality of gaussians being associated with a respective first parameter and a respective second parameter, a value of the respective first parameter is less than the third threshold value and a value of the respective second parameter is less than the fourth threshold value;
and
generating a rendered image of the scene using the third and the fourth plurality of gaussians.

8 more elements

A device to support dynamic culling of gaussians to render a scene, the device includes one or more processors executing instructions stored on a memory, the device configured to:

receive a first plurality of gaussians representing the scene, each gaussian of the first plurality being associated with a respective first parameter and a respective second parameter;
receive a first threshold value and a second threshold value;
receive a request to render the scene;
initiate a discovery operation to discover at least one gaussian of the first plurality, a value of a first parameter of the at least one gaussian is less than the first threshold value and a value of a second parameter of the at least one gaussian is less than the second threshold value;
in response to determining that the discovery operation to discover the at least one gaussian was successful, cull the at least one gaussian;
generate a second plurality of gaussians, the second plurality of gaussians being based at least in part on the first plurality of gaussians, each gaussian of the second plurality of gaussians being associated with a respective first parameter and a respective second parameter, and a value of the respective first parameter is equal to or greater than the first threshold value, or a value of the respective second parameter is equal to or greater than the second threshold value, or both;
and
generate a first rendered image of the scene using the second plurality of gaussians.

5 more elements

Dependencies are inferred from the claim text.