Neural upsampling and denoising rendered images
AssigneeArm Limited
InventorsLiam James O'Neil, Ridhwanul Haque, Yanxiang Wang, Joshua James Sowerby, Samuel James Edward Martin
Life of this patent
Estimating the term…
Abstract
One or more lighting components are projected onto pixel locations of a rendered image with sampling locations set off from pixel location centers according to associated jitter vectors. The sampled image is denoised in way that preserves the associated jitter vectors, and may be performed separately for different lighting components. The denoised image is processed using upsampling and/or temporal antialiasing, using the associated jitter vectors, to an image format having a spatial resolution at least as high as the denoised image.
Claims19
A method comprising:
- projecting one or more lighting components onto pixel locations of a rendered image in a first image format, the projected one or more lighting components being set off from pixel location centers in the first image format according to associated jitter vectors;
- for at least one of the one or more lighting components, denoising projected lighting components in the rendered image to provide a denoised image in the first image format, wherein the denoising projected lighting components preserves the associated jitter vectors;
- and
- transforming the denoised image to a processed image in a second image format, the processed image to be transformed by application of upsampling or temporal anti-aliasing, or a combination thereof, using the associated jitter vectors, the second image format having a spatial resolution at least as high as the first image format.
A computing device, comprising:
- a memory comprising one more storage devices;
- and
- one or more processors coupled the memory, the one or more processors operable to, for at least one image:
- project one or more lighting components onto pixel locations of a rendered image in a first image format, the projected one or more lighting components being set off from pixel location centers in the first image format according to associated jitter vectors;
- for at least one of the one or more lighting components, denoise projected lighting components in the rendered image to provide a denoised image in the first image format, wherein the denoising projected lighting components preserves the associated jitter vectors;
- and
- transform the denoised image to a processed image in a second image format, the processed image transformed by application of upsampling or temporal antialiasing, or a combination thereof, using the associated jitter vectors, the second image format having a spatial resolution at least as high as the first image format.
Dependencies are inferred from the claim text.