Watermark-Based Image Reconstruction
AssigneeGoogle Inc.
InventorsInnfarn Yoo, Feng Yang, Xiyang Luo
Life of this patent
Estimating the term…
Abstract
A computer-implemented method that provides watermark-based image reconstruction to compensate for lossy encoding schemes. The method can generate a difference image describing the data loss associated with encoding an image using a lossy encoding scheme. The difference image can be encoded as a message and embedded in the encoded image using a watermark and later extracted from the encoded image. The difference image can be added to the encoded image to reconstruct the original image. As an example, an input image encoded using a lossy JPEG compression scheme can be embedded with the lost data and later reconstructed, using the embedded data, to a fidelity level that is identical or substantially similar to the original.
Claims20
One or more non-transitory computer-readable media that store instructions that, when executed by one or more processors of a computing system, cause the computing system to perform operations for using learned image reconstruction to compensate for lossy video encoding, the operations comprising:
- obtaining an encoded version of image data comprising a plurality of encoded original image frames, the encoded version of the image data comprising an embedded latent representation that describes data lost from the image data during encoding of the encoded version of the image data;
- generating, by a machine-learned reconstruction model based on the embedded latent representation, a reconstruction output describing a reconstruction of the data lost from the image data during encoding of the encoded version of the image data;
- and
- generating, based on the reconstruction output and based on decoding the encoded version of the image data, a reconstruction of the original image frames.
A video encoding system comprising:
- a lossy video encoder configured to encode compressed video files for decoding by a video decoder;
- a machine-learned embedding model trained to generate a respective learned latent representation associated with a respective compressed video file encoded by the lossy video encoder, the respective learned latent representation configured to cause a machine-learned reconstruction model to reconstruct image data lost from the respective compressed video file after decoding, using the video decoder, the respective compressed video file.
A video decoding system comprising:
- a video decoder configured to decode compressed video files encoded by a lossy video encoder;
- a machine-learned reconstruction model trained to reconstruct, based on a respective learned latent representation associated with a respective compressed video file encoded by the lossy video encoder, image data lost from the respective compressed video file after decoding, using the video decoder, the respective compressed video file.
One or more non-transitory computer-readable media that store:
- a digital image file comprising:
- encoded pixel data from original image data encoded by a lossy encoder;
- and
- an embedded latent representation configured to cause a machine-learned reconstruction model to generate a reconstruction output describing a reconstruction of the data lost from the original image data during encoding of the image data by the lossy encoder.
Dependencies are inferred from the claim text.