US 2019/0057527 A1 · Digital Media Environment for Style-Aware Patching in a Digital Image

Abstract

Techniques and systems are described for style-aware patching of a digital image in a digital medium environment. For example, a digital image creation system generates style data for a portion to be filled of a digital image, indicating a style of an area surrounding the portion. The digital image creation system also generates content data for the portion indicating content of the digital image of the area surrounding the portion. The digital image creation system selects a source digital image based on similarity of both style and content of the source digital image at a location of the patch to the style data and content data. The digital image creation system transforms the style of the source digital image based on the style data and generates the patch from the source digital image in the transformed style for incorporation into the portion to be filled of the digital image.

Claims22

Dependent claims

In a digital medium environment for style-aware patching in a digital image, a method implemented by at least one computing device, the method comprising:

determining, by the at least one computing device, a portion to be filled in the digital image, the portion to be filled corresponding to a defect in the digital image;
generating, by the at least one computing device, for the portion to be filled in the digital image:
style data for the portion indicating a style of an area surrounding the portion to be filled;
and
content data for the portion indicating content of the digital image of the area surrounding the portion to be filled;
selecting, by the at least one computing device, a source digital image from a plurality of digital images to generate a patch for the portion to be filled based on:
a similarity of a style of the source digital image at a location of the patch to the style data;
and
a similarity of content of the source digital image at the location of the patch to the content data;
and
generating, by the at least one computing device, the patch from the source digital image for the portion to be filled in the digital image, the patch repairing the defect of the digital image.

8 more elements

In a digital medium environment for style-aware patching in a digital image in a digital image creation system, a system comprising:

a patch selection module implemented at least partially in hardware of at least one computing device to select a patch from a source digital image based on a similarity of content and a similarity of style between an area surrounding a portion to be filled of the digital image and the patch of the source digital image;
a style determination module implemented at least partially in hardware of the at least one computing device to generate style data for the area surrounding the portion to be filled of the digital image and independent of the content of the area surrounding the portion to be filled of the digital image;
a style transformation module implemented at least partially in hardware of the at least one computing device to transform the style of the source digital image based on the style data for the area surrounding the portion to be filled of the digital image;
and
a patch generation module implemented at least partially in hardware of the at least one computing device to:
generate the patch from the source digital image in the transformed style for incorporation into the portion to be filled of the digital image;
crop the patch from the source digital image in the transformed style to match a size of a cell of a grid in the portion to be filled of the digital image;
and
copy the cropped patch to the cell in a location of the grid within the portion to be filled of the digital image.

6 more elements

In a digital medium environment for style-aware patching in a digital image in a digital image creation system, a system comprising:

means for generating, for a portion to be filled in the digital image:
style data for the portion indicating a style of an area surrounding the portion to be filled;
and
content data for the portion indicating content of the digital image of the area surrounding the portion to be filled;
means for selecting a source digital image from a plurality of digital images to generate a patch for the portion to be filled by sampling candidate patches in the portion to be filled of the digital image to produce a collection of candidate patches based on:
a similarity of a style of the source digital image at a location of the patch to the style data;
and
a similarity of content of the source digital image at the location of the patch to the content data;
and
means for generating the patch from the source digital image for the portion to be filled in the digital image.

7 more elements

Dependencies are inferred from the claim text.

Digital Media Environment for Style-Aware Patching in a Digital Image

Life of this patent

Digital Media Environment for Style-Aware Patching in a Digital Image

Life of this patent

Abstract

Claims22