Techniques for reducing noise in video
AssigneeNVIDIA Corporation
InventorsSeungseok OH, Sean Pieper
Life of this patent
Estimating the term…
Abstract
Systems and techniques for noise reduction in video are described. Example implementations provide improved motion-adaptive temporal or spatio-temporal noise reduction that use an improved blending of the current frame with previous frames. The improved blending may be particularly effective for processing video captured in noisy environments such as low-light and/or mobile environments. In some example implementations, the improved blending is based on more accurately distinguishing between pixel difference in adjacent images that are caused by motion rather than noise.
Claims21
A method of video noise reduction comprising:
- determining a difference metric for a frame of a sequence of video frames;
- determining, using the determined difference metric, a blending factor for blending the frame with another frame of the sequence, wherein the determining the blending factor includes at least one of (a) determining the blending factor jointly for a plurality of color channels, (b) non-linearly associating the determined difference metric with the blending factor, (c) restricting the determined blending factor to a maximum value determined according to a noise variance in the another frame, (d) restricting the determined blending factor to a maximum value based on a previous blending factor, or (e) changing a value of the blending factor according to one or more dynamically configurable coefficients;
- and
- blending the frame and the another frame according to the determined blending factor.
A system comprising at least one graphics processing unit (GPU) configured to receive a sequence of video frames from a video producer and perform video noise reduction operations comprising:
- determining a difference metric for a frame of the sequence of video frames;
- determining, using the determined difference metric, a blending factor for blending the frame with another frame of the sequence, wherein the determining the blending factor includes at least one of (a) determining the blending factor jointly for a plurality of color channels, (b) non-linearly associating the determined difference metric with the blending factor, (c) restricting the determined blending factor to a maximum value determined according to a noise variance in the another frame, (d) restricting the determined blending factor to a maximum value based on a previous blending factor, or (e) changing a value of the blending factor according to one or more dynamically configurable coefficients;
- and
- blending the frame and the another frame according to the determined blending factor.
A non-transitory computer readable storage medium storing instructions that, when executed by at least one processor, causes the at least one processor to perform operations comprising:
- determining a difference metric for a frame of a sequence of video frames;
- determining, using the determined difference metric, a blending factor for blending the frame with another frame of the sequence, wherein the determining the blending factor includes (a) determining the blending factor jointly for a plurality of color channels and/or (b) non-linearly associating the determined difference metric with the blending factor and/or (c) restricting the determined blending factor to a maximum value determined according to a noise variance in the another frame and/or (d) restricting the determined blending factor to a maximum value based on a previous blending factor and/or (e) changing a value of the blending factor according to one or more dynamically configurable coefficients;
- and
- blending the frame and the another frame according to the determined blending factor.
Dependencies are inferred from the claim text.