Systems and methods for generating images using diffusion model
AssigneeWoven By Toyota, Inc.
InventorKoichiro YAMAGUCHI
Life of this patent
Estimating the term…
Abstract
Provided are a method, system, and device for generating synthetic images. The method may include, receiving an input image; removing at least one pre-existing object from the input image; inpainting the region where the at least one pre-existing object was removed; estimating a position of another pre-existing object from the input image; generating a layout over the input image based on the estimated position; and generating a synthetic object based on the layout.
Claims20
A method for generating a synthetic image, the method comprising:
- receiving an input image;
- removing at least one pre-existing object from the input image;
- inpainting the region where the at least one pre-existing object was removed;
- estimating a position of another pre-existing object from the input image;
- generating a layout over the input image based on the estimated position;
- and
- generating a synthetic object based on the layout.
A method for generating a synthetic image using a diffusion model, the method comprising:
- obtaining road data;
- determining a location of one or more objects relative to the road data, based on one or more input parameters;
- projecting one or more object bounding boxes, corresponding to the one or more objects, on an image plane based on the determined location, the image plane being from a perspective of a camera;
- and
- generating an image using a diffusion model based on a layout of the one or more object bounding boxes.
An apparatus for generating a synthetic image, the apparatus comprising:
- at least one memory storing computer-executable instructions;
- and
- at least one processor configured to execute the computer-executable instructions to:
- receive an input image;
- remove at least one pre-existing object from the input image;
- inpaint the region where the at least one pre-existing object was removed;
- estimate a position of another pre-existing object from the input image;
- generate a layout over the input image based on the estimated position;
- and
- generate a synthetic object based on the layout.
The apparatus according to claim 13, wherein the at least one processor is further configured to execute the computer-executable instructions to estimate a position of the another pre-existing object by:
- estimating the depth of the road structure object
An apparatus for generating a synthetic image using a diffusion model, the apparatus comprising:
- at least one memory storing computer-executable instructions;
- and
- at least one processor configured to execute the computer-executable instructions to:
- obtain road data;
- determine a location of one or more objects relative to the road data, based on one or more input parameters;
- project one or more object bounding boxes, corresponding to the one or more objects, on an image plane based on the determined location, the image plane being from a perspective of a camera;
- and
- generate an image using a diffusion model based on a layout of the one or more object bounding boxes.
Dependencies are inferred from the claim text.