Image inpainting based on multiple image transformations
AssigneeAdobe Inc.
InventorsYuqian Zhou, Elya Shechtman, Connelly Stuart Barnes, Sohrab Amirghodsi
Life of this patent
Estimating the term…
Abstract
Various disclosed embodiments are directed to inpainting one or more portions of a target image based on merging (or selecting) one or more portions of a warped image with (or from) one or more portions of an inpainting candidate (e.g., via a learning model). This, among other functionality described herein, resolves the inaccuracies of existing image inpainting technologies.
Claims20
A non-transitory computer readable medium storing computer-usable instructions that, when used by one or more processors, cause the one or more processors to perform operations comprising:
- receiving a target image and a source image;
- receiving an indication of a user request to inpaint a portion of the target image by filling in the portion with pixel values that match pixel values of another portion of the target image, the portion including a first set of pixels;
- in response to the receiving of the indication of the user request, generating a warped image by causing a first transformation of the source image and generating an inpainting candidate;
- producing a merged image by merging at least a first portion of the warped image with at least a second portion of the inpainting candidate, the merged image includes a second set of pixels that match one or more features of the another portion of the target image;
- and
- based at least in part on the merging and as part of executing the user request, causing an inpaint of the portion of the target image by replacing the first set of pixels with the second set of pixels such that the target image no longer includes the portion.
A computer-implemented method comprising:
- receiving a target image and a source image;
- receiving an indication of a user request to inpaint by patching a hole at the target image with other pixels;
- in response to the receiving of the indication of the user request, generating a first warped image by causing a first transformation of the source image and generating an inpainting candidate;
- selecting at least one portion of the warped image and the inpainting candidate, the warped image and the inpainting candidate being candidates to patch the hole;
- and
- based at least in part on the selecting and as part of executing the user request, cause an inpaint of the hole of the target image.
A computerized system, the system comprising:
- one or more processors;
- and
- computer storage memory having computer-executable instructions stored thereon which, when executed by the one or more processors, implement a method comprising:
- receiving a target image and a source image,
- receiving an indication of a user request to inpaint one or more portions of the target image by removing first pixels of the one or more portions and replacing the first pixels with other pixels, and
- in response to the receiving of the indication of the user request, generating a warped image by causing a first transformation of the source image and generating an inpainting candidate, the warped image and the inpainting candidate being candidates for the replacing of the first pixels with other pixels;
- selecting from at least one portion the warped image and the inpainting candidate;
- and
- based at least in part on the selecting, cause an inpaint of the one or more portions of the target image.
Dependencies are inferred from the claim text.