Sky editing based on image composition
AssigneeAdobe Inc.
InventorsXiaohui Shen, Yi-Hsuan Tsai, Kalyan K. Sunkavalli, Zhe Lin
Life of this patent
Estimating the term…
Abstract
Embodiments of the present disclosure relate to a sky editing system and related processes for sky editing. The sky editing system includes a composition detector to determine the composition of a target image. A sky search engine in the sky editing system is configured to find a reference image with similar composition with the target image. Subsequently, a sky editor replaces content of the sky in the target image with content of the sky in the reference image. As such, the sky editing system transforms the target image into a new image with a preferred sky background.
Claims20
A computer-implemented method for editing images, comprising:
- constructing, by one or more processors, a first composite label representing a first composition of a foreground of a first image and a second composite label representing a second composition of a background of the first image;
- constructing, based on the first composite label and the second composite label, a composite label to represent a first layout of the first image;
- identifying, by the one or more processors, based on the composite label, a second image having a second layout similar to the first layout;
- and
- generating, by the one or more processors, a composite image including a first portion of the first image and a second portion of the second image, wherein the generating comprises extracting, from the second image, a maximum rectangular region without a foreground of the second image, and rescaling the maximum rectangular region to a size of a minimum rectangle region to cover all the background of the first image.
A non-transitory computer storage medium comprising computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations comprising:
- constructing a first label representing a first composition of a foreground of a first image and a second label representing a second composition of a background of the first image;
- constructing, based on the first label and the second label, a composite label to represent a first layout of the first image;
- identifying, based on the composite label, a second image having a second layout similar to the first layout;
- and
- generating a composite image based on a first portion of the first image and a second portion of the second image, wherein the generating comprises extracting, from the second image, a maximum rectangular region without a foreground of the second image, and rescaling the maximum rectangular region to match a size of the background of the first image.
A computer system, comprising:
- a computer memory;
- and
- a processor, operationally coupled with the computer memory, configured to execute operations comprising:
- constructing a first label representing a first composition of a foreground of a first image and a second label representing a second composition of a background of the first image;
- constructing, based on the first label and the second label, a composite label to represent a first layout of the first image;
- identifying, based on the composite label, a second image having a second layout similar to the first layout;
- extracting, from the second image, a maximum rectangular region without a foreground of the second image;
- rescaling the maximum rectangular region to match a size of the background of the first image;
- and
- generating a composite image based on the rescaled maximum rectangular region and the foreground of the first image.
Dependencies are inferred from the claim text.