Augmenting temporal anti-aliasing with a neural network for history validation

A method comprising:

• receiving, by a processing resource hosting a history validation neural network, inputs for the history validation neural network, wherein the inputs are for a current pixel of a current frame and a reprojected pixel corresponding to the current pixel, and wherein the reprojected pixel originating from history data of the current frame;
• generating, by the processing resource using an output of the history validation neural network, a validated color for the current pixel based on current color data corresponding to the current pixel and history color data corresponding to the reprojected pixel;
• rendering, by the processing resource, an output frame using the validated color;
• and
• adding, by the processing resource, the output frame to the history data.

A system comprising:

• a memory device;
• and
• a graphics processor coupled with the memory device, the graphics processor comprising a set of processing resources to perform augmented temporal anti-aliasing (TAA), the set of processing resources including circuitry configured to:
• receive, at a history validation neural network, inputs for a current pixel of a current frame and a reprojected pixel corresponding to the current pixel, the reprojected pixel originating from history data of the current frame;
• generate, using an output of the history validation neural network, a validated color for the current pixel based on current color data corresponding to the current pixel and history color data corresponding to the reprojected pixel;
• render an output frame using the validated color;
• and
• add the output frame to the history data.

A non-transitory computer-readable storage medium having stored thereon executable computer program instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

• receiving, by the one or more processors hosting a history validation neural network, inputs for the history validation neural network, wherein the inputs are for a current pixel of a current frame and a reprojected pixel corresponding to the current pixel, and wherein the reprojected pixel originating from history data of the current frame;
• generating, by the one or more processors using an output of the history validation neural network, a validated color for the current pixel based on current color data corresponding to the current pixel and history color data corresponding to the reprojected pixel;
• rendering, by the one or more processors, an output frame using the validated color;
• and
• adding, by the one or more processors, the output frame to the history data.