Back to results
US 12,770,305 B2Granted
One-step diffusion distillation via deep equilibrium models
AssigneeRobert Bosch GmbH
InventorsZhengyang Geng, Ashwini Polke, Jeremy Kolter, Bahare Azari, Ivan Batalov, Filipe Condessa
Life of this patent
Estimating the term…
Abstract
Generative equilibrium transformers are disclosed. Disclosed embodiments provide a simple and effective technique that can distill a multi-step diffusion process into a single-step generative model using solely noise/image pairs.
Claims20
A method comprising:
- converting noise into a sequence of two-dimensional patches;
- producing a noise embedding vector from the sequence of two-dimensional patches;
- tokenizing the noise embedding vector via an injection transformer;
- inputting the tokenized noise into an equilibrium transformer;
- solving a fixed point via the equilibrium transformer;
- and
- decoding the fixed point to generate an image sample.
4 more elements
A non-transitory memory including computer-executable instructions that when executed by a system cause the system to perform operations including:
- converting noise into a sequence of two-dimensional patches;
- producing a noise embedding vector from the sequence of two-dimensional patches;
- tokenizing the noise embedding vector via an injection transformer;
- inputting the tokenized noise into an equilibrium transformer;
- solving a fixed point via the equilibrium transformer;
- and
- decoding the fixed point to generate an image sample.
4 more elements
A system, comprising:
- one or more processors;
- and
- a non-transitory memory including computer-executable instructions that when executed by the one or more processors cause the system to perform operations including:
- converting noise into a sequence of two-dimensional patches;
- producing a noise embedding vector from the sequence of two-dimensional patches;
- tokenizing the noise embedding vector via an injection transformer;
- inputting the tokenized noise into an equilibrium transformer;
- solving a fixed point via the equilibrium transformer;
- and
- decoding the fixed point to generate an image sample.
7 more elements
Dependencies are inferred from the claim text.