Path guiding using neural radiance caching with defensive resampled importance sampling and adaptive candidate allocation

One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

• receiving a representation of a three-dimensional (3D) scene and a virtual camera location;
• generating, based on at least the representation, a lightpath that originates at the virtual camera location and reaches a point included in the 3D scene;
• determining, for the point, a candidate count specifying a number of candidate directions to be considered for extending the lightpath from the point, wherein the candidate count is determined based at least on one or more rendering efficiency metrics;
• generating, in accordance with the candidate count, a set of candidate directions for extending the lightpath from the point;
• extending the lightpath in a selected direction;
• and
• generating a two-dimensional (2D) rendering of the 3D scene based at least on the generated lightpath.

A system comprising:

• one or more memories storing instructions;
• and
• one or more processors for executing the instructions to:
• receive a representation of a three-dimensional (3D) scene and a virtual camera location;
• generate, based on at least the representation, a lightpath that originates at the virtual camera location and reaches a point included in the 3D scene;
• determine, for the point, a candidate count specifying a number of candidate directions to be considered for extending the lightpath from the point, wherein the candidate count is determined based at least on one or more rendering efficiency metrics;
• generate, in accordance with the candidate count, a set of candidate directions for extending the lightpath from the point;
• extend the lightpath in a selected direction;
• and
• generate a two-dimensional (2D) rendering of the 3D scene based at least on the generated lightpath.