Computing perceptual similarity directly in latent space

Abstract

A method, apparatus, non-transitory computer readable medium, and system for assessing perceptual similarity include training an image generation model based on a latent code perceptual similarity by obtaining training data including a first latent code representing a first image and a second latent code representing a second image and encoding, using a perceptual similarity model, the first latent code and the second latent code to obtain a first feature stack and a second feature stack, respectively. The perceptual similarity model generates the latent code perceptual similarity based on the first feature stack and the second feature stack, wherein the latent code perceptual similarity represents a perceptual similarity between the first image and the second image. Then parameters of the image generation model are updated based on the latent code perceptual similarity.

Dependencies are inferred from the claim text.