Visual quality optimized video compression
AssigneeIntel Corporation
InventorsMaria Bortman, Tzach Ashkenazi, Ilya Romm, Gaby Prechner
Life of this patent
Estimating the term…
Abstract
Techniques related to providing high perceptual quality video from highly compressed and decompressed reconstructed video are discussed. Such techniques include applying a pretrained decompression upsampling portion of a generative adversarial network to the decompressed reconstructed video to upsample and improve the perceptual quality of the decompressed reconstructed video to generate output video.
Claims21
An apparatus comprising:
- a memory to store at least a portion of a received bitstream;
- and
- one or more processors coupled to the memory, the one or more processors to:
- decode the received bitstream to generate a first video picture of a decoded video stream, wherein the first video picture comprises a first resolution;
- apply a pretrained decompression upsampling portion of a generative adversarial network to the first video picture to upsample and improve the perceptual quality of the first video picture to generate a second video picture, wherein the second video picture comprises a second resolution greater than the first resolution, and wherein the pretrained decompression upsampling portion comprises a plurality of first residue blocks followed by a plurality of upsample blocks followed by at least one second residue block;
- and
- output the second picture.
At least one non-transitory machine readable medium comprising a plurality of instructions that, in response to being executed on a computing device, cause the computing device to:
- decode a received bitstream to generate a first video picture of a decoded video stream, wherein the first video picture comprises a first resolution;
- apply a pretrained decompression upsampling portion of a generative adversarial network to the first video picture to upsample and improve the perceptual quality of the first video picture to generate a second video picture, wherein the second video picture comprises a second resolution greater than the first resolution, and wherein the pretrained decompression upsampling portion comprises a plurality of first residue blocks followed by a plurality of upsample blocks followed by at least one second residue block;
- and
- output the second picture.
An apparatus comprising:
- a memory to store at least a portion of a received bitstream;
- and one or more processors coupled to the memory, the one or more processors to:
- decode the received bitstream to generate a first video picture of a decoded video stream, wherein the first video picture comprises a first resolution;
- receive a first region indicator corresponding to a first region of the first video picture and a second region indicator corresponding to a second region of the first video picture;
- apply a pretrained decompression upsampling portion of a generative adversarial network to the first video picture to upsample and to improve the perceptual quality of the first video picture to generate a second video picture, wherein the second video picture comprises a second resolution greater than the first resolution, and wherein the pretrained decompression upsampling portion is applied only to the first region in response to the first region indicator and the pretrained decompression upsampling portion is not applied to the second region in response to the second region indicator;
- and output the second picture.
At least one non-transitory machine readable medium comprising a plurality of instructions that, in response to being executed on a computing device, cause the computing device to:
- decode a received bitstream to generate a first video picture of a decoded video stream, wherein the first video picture comprises a first resolution;
- receive a first region indicator corresponding to a first region of the first video picture and a second region indicator corresponding to a second region of the first video picture;
- apply a pretrained decompression upsampling portion of a generative adversarial network to the first video picture to upsample and to improve the perceptual quality of the first video picture to generate a second video picture, wherein the second video picture comprises a second resolution greater than the first resolution, and wherein the pretrained decompression upsampling portion is applied only to the first region in response to the first region indicator and the pretrained decompression upsampling portion is not applied to the second region in response to the second region indicator;
- and output the second picture.
Dependencies are inferred from the claim text.