Back to results
US 12,579,606 B2Granted
Generative AI inferred prompt outpainting
AssigneeAdobe Inc.
InventorsMichael Spencer Cragg, Edward Christopher Wright, Davis Taylor Brown, Dana Michelle Jefferson, Andreas Kuefer
Life of this patent
Estimating the term…
Abstract
Systems and methods for image processing are provided. Embodiments of the present disclosure obtain an image and a target dimension for expanding the image. The system generates a prompt based on the image using a prompt generation network. A diffusion model generates an expanded image based on the image, the target dimension, and the prompt, where the expanded image includes additional content in an outpainted region that is consistent with content of the image and the prompt.
Claims20
A method comprising:
- obtaining an image and a target dimension from a user, wherein the image includes metadata indicating a camera setting used for capturing the image, and wherein the target dimension indicates an aspect ratio different from the image;
- generating a prompt based on the image using a prompt generation network, wherein the prompt includes a term based on the camera setting;
- and
- generating an expanded image based on the image, the target dimension, and the prompt using a diffusion model, wherein the expanded image includes additional content in an outpainted region that is consistent with the term based on the camera setting, and wherein the expanded image has the aspect ratio indicated by the target dimension.
1 more element
A method comprising:
- initializing a diffusion model;
- obtaining training data including an input image, a prompt, a target dimension, and a ground-truth expanded image, wherein the input image includes metadata indicating a camera setting used for capturing the input image, and wherein the target dimension indicates an aspect ratio different from the input image, and wherein the prompt includes a term based on the camera setting;
- and
- training the diffusion model to generate an expanded image that includes additional content in an outpainted region that is consistent with the term based on the camera setting and the training data, wherein the expanded image has the aspect ratio indicated by the target dimension.
1 more element
An apparatus comprising:
- a processor;
- and
- a memory including instructions executable by the processor to:
- obtain an image and a target dimension from a user, wherein the image includes metadata indicating a camera setting used for capturing the image, and wherein the target dimension indicates an aspect ratio different from the image;
- generate a prompt based on the image using a prompt generation network, wherein the prompt includes a term based on the camera setting;
- and
- generate an expanded image based on the image, the target dimension, and the prompt using a diffusion model, wherein the expanded image includes additional content in an outpainted region that is consistent with the term based on the camera setting, and wherein the expanded image has the aspect ratio indicated by the target dimension.
4 more elements
Dependencies are inferred from the claim text.