Compressing image-to-image models with average smoothing
AssigneeSnap Inc.
InventorsJian Ren, Menglei Chai, Sergey Tulyakov, Qing Jin
Life of this patent
Estimating the term…
Loading patent…
AssigneeSnap Inc.
InventorsJian Ren, Menglei Chai, Sergey Tulyakov, Qing Jin
Estimating the term…
System and methods for compressing image-to-image models. Generative Adversarial Networks (GANs) have achieved success in generating high-fidelity images. An image compression system and method adds a novel variant to class-dependent parameters (CLADE), referred to as CLADE-Avg, which recovers the image quality without introducing extra computational cost. An extra layer of average smoothing is performed between the parameter and normalization layers. Compared to CLADE, this image compression system and method smooths abrupt boundaries, and introduces more possible values for the scaling and shift. In addition, the kernel size for the average smoothing can be selected as a hyperparameter, such as a 3×3 kernel size. This method does not introduce extra multiplications but only addition, and thus does not introduce much computational overhead, as the division can be absorbed into the parameters after training.
A method of operating a generative adversarial network (GAN), comprising:
A system comprising:
A non-transitory computer-readable storage medium including instructions that, when executed by a computer, cause the computer to perform operations comprising:
Dependencies are inferred from the claim text.