Fine-tuning a likelihood-based generative model by contrasting to training data
AssigneeNVIDIA Corporation
InventorsQinsheng Zhang, Kaiwen Zheng, Yongxin Chen, Ming-Yu Liu
Life of this patent
Estimating the term…
Loading patent…
AssigneeNVIDIA Corporation
InventorsQinsheng Zhang, Kaiwen Zheng, Yongxin Chen, Ming-Yu Liu
Estimating the term…
Diffusion and autoregressive models are representatives of likelihood-based generative models which aim to learn an underlying data distribution by maximizing the likelihood of the observed data under a parameterized probabilistic model. These likelihood-based generative models are particularly effective at performing visual tasks such as image and video synthesis. However, the maximum likelihood estimation (MILE) objective entails inherent limitations, such as forcing the learned density to spread out excessively, potentially leading to blurry samples. The present disclosure improves likelihood-based generative models by contrasting to training data, which can push the performance of likelihood-based generative models beyond the limits of MLE.
A method, comprising:
A method, comprising:
A system, comprising:
A non-transitory computer-readable media storing computer instructions which when executed by one or more processors of a device cause the device to:
Dependencies are inferred from the claim text.