Loop restoration filtering for super resolution video coding
AssigneeIntel Corporation
InventorsXimin Zhang, Sang-Hee Lee, Keith W. Rowe
Life of this patent
Estimating the term…
Abstract
Techniques related to selecting restoration filter coefficients for 2-dimensional loop restoration filters for super resolution video coding are discussed. Such techniques include upscaling reconstructed video frames along only a first dimension and selecting filter coefficients for portions of the frame by an evaluation that, for each pixel of the portion, uses only pixel values that are aligned with the first dimension. Selection of filter coefficients for the second dimension may be skipped or made using only a subset of available filter coefficients.
Claims20
A video coding system comprising:
- a memory to store a reconstructed video frame of video for coding;
- and
- a processor coupled to the memory, the processor to:
- upscale the reconstructed video frame in only a first dimension to generate a reconstructed and upscaled video frame;
- determine, for at least a portion of the reconstructed and upscaled video frame, first filter coefficients, along the first dimension, of a separable and symmetric 2-dimensional restoration filter to be applied to the portion based on evaluation of 1-dimensional correlation between the portion and original pixel values of an original frame of video that, for each pixel of the portion, uses only pixel values that are aligned with the first dimension;
- select, for the portion, second filter coefficients along a second dimension of the 2-dimensional restoration filter based on evaluation of a subset of available sets of filter coefficients;
- and
- code the video, to generate a bitstream, based at least in part on application of the separable and symmetric 2-dimensional restoration filter using the first and second filter coefficients to restoration filter the portion.
A method for encoding video comprising:
- upscaling a reconstructed video frame in only a first dimension to generate a reconstructed and upscaled video frame;
- determining, for at least a portion of the reconstructed and upscaled video frame, first filter coefficients, along the first dimension, of a separable and symmetric 2-dimensional restoration filter to be applied to the portion based on evaluation of 1-dimensional correlation between the portion and original pixel values of an original frame of video that, for each pixel of the portion, uses only pixel values that are aligned with the first dimension;
- selecting, for the portion, second filter coefficients along a second dimension of the 2-dimensional restoration filter based on evaluation of a subset of available sets of filter coefficients;
- and
- coding the video, to generate a bitstream, based at least in part on application of the separable and symmetric 2-dimensional restoration filter using the first and second filter coefficients to restoration filter the portion.
At least one non-transitory machine readable medium comprising a plurality of instructions that, in response to being executed on a computing device, cause the computing device to code video by:
- upscaling a reconstructed video frame in only a first dimension to generate a reconstructed and upscaled video frame;
- determining, for at least a portion of the reconstructed and upscaled video frame, first filter coefficients, along the first dimension, of a separable and symmetric 2-dimensional restoration filter to be applied to the portion based on evaluation of 1-dimensional correlation between the portion and original pixel values of an original frame of video that, for each pixel of the portion, uses only pixel values that are aligned with the first dimension;
- selecting, for the portion, second filter coefficients along a second dimension of the 2-dimensional restoration filter based on evaluation of a subset of available sets of filter coefficients;
- and
- coding the video, to generate a bitstream, based at least in part on application of the separable and symmetric 2-dimensional restoration filter using the first and second filter coefficients to restoration filter the portion.
Dependencies are inferred from the claim text.