Compressing images using neural networks
AssigneeDeepMind Technologies Limited
InventorsDaniel Pieter Wierstra, Karol Gregor, Frederic Olivier Besse
Life of this patent
Estimating the term…
Abstract
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for compressing images using neural networks. One of the methods includes receiving an image; processing the image using an encoder neural network, wherein the encoder neural network is configured to receive the image and to process the image to generate an output defining values of a first number of latent variables that each represent a feature of the image; generating a compressed representation of the image using the output defining the values of the first number of latent variables; and providing the compressed representation of the image for use in generating a reconstruction of the image.
Claims18
A method comprising:
- receiving an image;
- processing the image using an encoder neural network, wherein the encoder neural network is configured to receive the image and to process the image to generate an output defining values of latent variables that each represent a feature of the image;
- generating a lossy compressed representation of the image using a first number of the latent variables that is less than all of the latent variables that have values that are defined by the output;
- providing the lossy compressed representation of the image for use in generating a reconstruction of the image;
- and
- generating the reconstruction of the image from the lossy compressed representation of the image, comprising:
- selecting a value of the latent variables that are not in the first number of latent variables randomly from a prior distribution;
- and
- generating the reconstruction of the image by conditioning a generative neural network on the values of the first number of latent variables and the randomly selected values of the latent variables that are not in the first number of latent variables.
A system comprising one or more computers and one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to perform operations comprising:
- receiving an image;
- processing the image using an encoder neural network, wherein the encoder neural network is configured to receive the image and to process the image to generate an output defining values of latent variables that each represent a feature of the image;
- generating a lossy compressed representation of the image using a first number of the latent variables that is less than all of the latent variables that have values that are defined by the output;
- providing the lossy compressed representation of the image for use in generating a reconstruction of the image;
- and
- generating the reconstruction of the image from the lossy compressed representation of the image, comprising:
- selecting a value of the latent variables that are not in the first number of latent variables randomly from a prior distribution;
- and
- generating the reconstruction of the image by conditioning a generative neural network on the values of the first number of latent variables and the randomly selected values of the latent variables that are not in the first number of latent variables.
One or more non-transitory computer storage media storing instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:
- receiving an image;
- processing the image using an encoder neural network, wherein the encoder neural network is configured to receive the image and to process the image to generate an output defining values of latent variables that each represent a feature of the image;
- generating a lossy compressed representation of the image using a first number of the latent variables that is less than all of the latent variables that have values that are defined by the output;
- providing the lossy compressed representation of the image for use in generating a reconstruction of the image;
- and
- generating the reconstruction of the image from the lossy compressed representation of the image, comprising:
- selecting a value of the latent variables that are not in the first number of latent variables randomly from a prior distribution;
- and
- generating the reconstruction of the image by conditioning a generative neural network on the values of the first number of latent variables and the randomly selected values of the latent variables that are not in the first number of latent variables.
Dependencies are inferred from the claim text.