Systems and Methods for Synthetic Image Generation based on RNA Expression

A method of generating synthetic histological slide images, comprising:

• obtaining a plurality of RNA-Seq records;
• obtaining a plurality of histological slide images, where each histological slide image is associated with one of the RNA-Seq records;
• translating each record in the plurality of RNA-Seq records into a latent space using an encoder component of a variational auto encoder;
• training a first diffusion model to produce a first synthetic histological slide image at a lower resolution using the translated plurality of RNA-Seq records and the associated histological slides;
• training a second diffusion model to upscale lower resolution synthetic histological slide images to higher resolution synthetic histological slide images using lower resolution images produced by the first diffusion model and the associated histological slide images;
• obtaining a given RNA-Seq record;
• translating the given RNA-Seq record into the latent space using the encoder component of the variational autoencoder;
• providing the latent representation of the given RNA-Seq record to the trained first diffusion model;
• generating a given lower resolution synthetic histological slide image using the trained first diffusion model;
• providing the given lower resolution synthetic histological slide image to the trained second diffusion model;
• and
• generating a given higher resolution synthetic histological slide image using the trained second diffusion model.