Image region filling by example-based tiling
AssigneeMicrosoft Corporation
InventorsPatrick Perez, Michel Gangnet, Andrew Blake
Life of this patent
Estimating the term…
Abstract
An example-based filling system identifies appropriate filling material to replace a destination region in an image and fills the destination region using this material, thereby alleviating or minimizing the amount of manual editing required to fill a destination region in image. Tiles of image data are borrowed from the proximity of the destination region or some other source to generate new image data to fill in the region. Destination regions may be designated by user input (e.g., selection of an image region by a user) or by other means (e.g., specification of a color or feature to be replaced).
Claims35
A method of filling a destination region in an image with one or more example tiles, the method comprising:
- selecting a destination tile within the destination region, the destination tile being associated with a destination neighborhood containing at least one of original image data from outside the destination region and filled-in image data;
- selecting a matching example tile from a plurality of example tiles, each example tile being associated with an example neighborhood, the matching example tile providing a best match between the example neighborhood of the matching example tile and the destination neighborhood of the destination tile;
- and
- replacing the destination tile in the image with the matching example tile.
A computer program product encoding a computer program for executing on a computer system a computer process for filling a destination region in an image with one or more example tiles, the computer process comprising:
- selecting a destination tile within the destination region, the destination tile being associated with a destination neighborhood containing at least one of original image data from outside the destination region and filled-in image data;
- selecting a matching example tile from a plurality of example tiles, each example tile being associated with an example neighborhood, the matching example tile providing a best match between the example neighborhood of the matching example tile and the destination neighborhood of the destination tile;
- and
- replacing the destination tile in the image with the matching example tile.
A system for filling a destination region in an image with one or more example tiles, the system comprising:
- a destination tile processing module selecting a destination tile within the destination region, the destination tile being associated with a destination neighborhood containing at least one of original image data from outside the destination region and filled-in image data;
- a matching module selecting a matching example tile from a plurality of example tiles, each example tile being associated with an example neighborhood, the matching example tile providing a best match between the example neighborhood of the matching example tile and the destination neighborhood of the destination tile;
- and
- a filling module replacing the destination tile in the image with the matching example tile.
A method of filling a destination region in an image with one or more example tiles, the method comprising:
- selecting a destination tile within the destination region, the destination tile being associated with a destination neighborhood containing at least one of original image data from outside the destination region and filled-in image data;
- replacing the destination tile in the image with a best matching example tile;
- and
- repeating the selecting and replacing operations until the destination region is filled.
A computer program product encoding a computer program for executing on a computer system a computer process for filling a destination region in an image with one or more example tiles, the computer process comprising:
- selecting a destination tile within the destination region, the destination tile being associated with a destination neighborhood containing at least one of original image data from outside the destination region and filled-in image data;
- replacing the destination tile in the image with a best matching example tile;
- and
- repeating the selecting and replacing operations until the destination region is filled.
Dependencies are inferred from the claim text.