Adaptive polynomial rendering
AssigneeDisney Enterprises, Inc.
InventorsBochang Moon, Markus Gross, Steven McDonagh, Kenneth J. Mitchell
Life of this patent
Estimating the term…
Loading patent…
AssigneeDisney Enterprises, Inc.
InventorsBochang Moon, Markus Gross, Steven McDonagh, Kenneth J. Mitchell
Estimating the term…
Embodiments can provide adaptive image filtering. Under this approach, image quality can be enhanced by adjusting an approximation function to better adapt image signals in different parts of an image. Certain parts of the image may be enhanced using a certain approximation function while some other parts of the image may be enhanced using a different approximation function. In certain embodiments, the approximation function selected for a part of the image can be a polynomial function having a specific order. The specific polynomial order can be applied directly to obtain an estimated image value of the part of the image. In certain embodiments, the estimation of the reconstruction error can include iteratively estimating a bias term of the reconstruction error and a variance term of the reconstruction error.
A method for rendering an image from a three-dimensional model, the method being performed by a computer system and comprising:
A system for rendering an image from a three-dimensional model, the system comprising one or more of a processors configured by machine-readable instructions to perform:
A computer program product resident on a non-transitory tangible media that is executable on a computer system comprising a processor, a display, and a user-input device, the computer program product comprising:
Dependencies are inferred from the claim text.
Drawings are temporarily unavailable. Open the PDF at USPTO
From the US filing history. Foreign family members aren’t listed.
No references of this kind are recorded.
Three-dimensional [3D] image rendering: ray-tracing
Special algorithmic details: adaptive image processing
Special algorithmic details: dividing image into blocks, subimages or windows
Special algorithmic details: filtering details
About 9 years 11 months of term left · ends 16 Sep 2036 (estimated)
Monte Carlo (MC) ray tracing is a rendering algorithm for synthesizing photo-realistic images from 3D models. MC rendering algorithm can typically be used to simulate a variety of rendering effects through a unified framework, i.e., ray tracing. The rendering time of MC ray tracing, however in many cases, is unacceptable since it typically requires integrating a huge number of ray samples, e.g., more than 10K ray samples per pixel, to generate a converged rendered image.
In attempting to tackle the aforementioned ray performance problem of MC ray tracing, various adaptive rendering techniques have been developed. Those techniques typically involve locally controlled sampling rate to adaptively adjust the image reconstruction. For example, some of those techniques involve adaptive sampling the heterogeneous noise property of rendered images to guide irregular sampling density rather than a uniform sampling, and locally controlling smoothing by considering MC noise so that high-frequency edges are properly preserved.
Adaptive image rendering has a long history. For example, Kajiya, J. T, in the paper entitled “the rendering equation” [ACM SIGGRAPH '86, 143-150], presented a general idea that high-dimensional MC samples can be allocated adaptively in a hierarchical structure by using the variances of the samples and these samples can be integrated to generate rendered images. Approaches using those techniques typically show high-quality rendering results for a moderate dimension (e.g., 2 to 5), but they typically suffer from the curse-of-dimensionality as the dimension of MC samples can be high (e.g., more than 10) when global illumination is simulated.
FIG. 1 illustrates generally a computer system that can be used to adaptively filter an image in accordance with the disclosure.
FIG. 2 is a flowchart of a method for adaptively filtering an image in accordance with the disclosure.
FIGS. 3A-B illustrate results of using function of different polynomial orders to reconstruct an image having a non-linear edge in accordance with the disclosure.
As used herein, a part of an image may be referred to as a pixel or a block of pixels of the image. For example, an image of 10000 pixels may be broken into 100×100 blocks, with each block having 100 pixels, such that there are 100 blocks on each pixel row and 100 blocks on each pixel column in the image. An image value for a part of the image as used herein can thus be referred to as an image value (e.g., color and opacity) for a pixel or a block of the image. For example, a block of pixels in the image can have an overall image value representing a color and opacity of the image block as a whole.
As used herein, filtering or reconstructing an image may be referred to as filtering or reconstructing a specific part of the image using an approximation function selected for that part of the image. The filtered or reconstructed image typically has an improved image quality compared to the original image.
As used herein, reconstructing a part of an image may be used interchangeably with filtering an part of an image. Either involves using an approximation function, such as a polynomial function, to enhance one or more image values of the part of the image.