Systems and methods for processing audiovisual data using latent codes from generative networks and models

A system for producing generator-coupled compressor mappings, the system comprising:

• a representative data set including a plurality of source images;
• an untrained generative model comprising a latent space and an untrained generator mapping, the latent space comprising a plurality of latent codes, the untrained generator mapping using a plurality of parameters to map each latent code to a generated image;
• a generator pretraining module that preprocesses a first subset of the representative dataset;
• a quality assessment module configured to convert image frames into quantities that assess the degree to which those image frames share characteristic features with image frames in the first subset of the representative data set preprocessed by the generator pretraining module;
• a generator training module that modifies the untrained generative model to optimize the result of the quality assessment module when applied to the output of the untrained generator mapping, thereby producing a trained generative model comprising the latent space and a trained generator mapping;
• an uncoupled compressor mapping that maps image frames to latent codes;
• a compressor pretraining module that preprocesses a second subset of the representative dataset;
• a reconstruction assessment module configured to convert a source image and latent code pair into a quantity, the quantity assessing the degree to which the source image resembles a reconstructed image frame, the reconstructed image frame produced by the latent code and the trained generator mapping;
• and
• a compressor training module that optimizes the uncoupled compressor mapping by changing its parameters to minimize the output of the reconstruction assessment module when applied to the image frames in the second subset of the representative data set preprocessed by the compressor training model paired with the latent codes produced by applying the uncoupled compressor mapping to those image frames, producing a generator-coupled compressor mapping.

A method for processing source images, the method comprising:

• defining a representative data set including a plurality of source images;
• deriving a trained generative model from the representative data set, the trained generative model comprising a latent space including a plurality of latent codes;
• mapping one or more latent codes to one or more generated image frames that share at least one characteristic feature with at least one of the source images in the representative data set;
• mapping one or more of the source images to one or more resulting latent codes, wherein the mapping of the one or more resulting latent codes to one or more reconstructed image frames resembles the one or more source images.