US 2024/0202270 A1 · Interactive Path Tracing on the Web

Abstract

A method renders photorealistic images in a web browser. The method is performed at a computing device having a general purpose processor and a graphics processing unit (GPU). The method includes obtaining an environment map and images of an input scene. The method also includes computing textures for the input scene including by encoding an acceleration structure of the input scene. The method further includes transmitting the textures to shaders executing on a GPU. The method includes generating samples of the input scene, by performing at least one path tracing algorithm on the GPU, according to the textures. The method also includes lighting or illuminating a sample of the input scene using the environment map, to obtain a lighted scene, and tone mapping the lighted scene. The method includes drawing output on a canvas, in the web browser, based on the tone-mapped scene to render the input scene.

Claims20

Dependent claims

A method of rendering images using path tracing, the method comprising:

obtaining an input image having a current pose;
rendering a current frame of the input image with a path-traced sample per pixel;
obtaining a prior frame corresponding to a prior pose, wherein the current frame and the prior frame have at least one overlapping pixel and each of the current frame and prior frame image data includes an alpha channel set to luminance contribution, for each pixel;
re-projecting samples from the prior frame into the current frame based on the alpha channel corresponding to each overlapping pixel with the current frame, including (i) blending diffuse light of the current frame with diffuse light of at least the prior frame using a long temporal filter, and (ii) blending specular light of the current frame with specular light of at least the prior frame using a short temporal filter;
and
modifying the current frame with the re-projected samples, including storing a number of samples rendered in the alpha channel for each pixel.

3 more elements

A computer system for rendering images using path tracing, comprising:

one or more processors, including a general purpose processor and a graphics processing unit (GPU);
a display;
and
memory;
wherein the memory stores one or more programs configured for execution by the one or more processors, and the one or more programs comprising instructions for:
obtaining an input image having a current pose;
rendering a current frame of the input image with a path-traced sample per pixel;
obtaining a prior frame corresponding to a prior pose, wherein the current frame and the prior frame have at least one overlapping pixel and each of the current frame and prior frame image data includes an alpha channel set to luminance contribution, for each pixel;
re-projecting samples from the prior frame into the current frame based on the alpha channel corresponding to each overlapping pixel with the current frame, including (i) blending diffuse light of the current frame with diffuse light of at least the prior frame using a long temporal filter, and (ii) blending specular light of the current frame with specular light of at least the prior frame using a short temporal filter;
and
modifying the current frame with the re-projected samples, including storing a number of samples rendered in the alpha channel for each pixel.

8 more elements

Dependencies are inferred from the claim text.

Interactive Path Tracing on the Web

Life of this patent

Interactive Path Tracing on the Web

Life of this patent

Abstract

Claims20