System and method for real-time texture synthesis using patch-based sampling
AssigneeMicrosoft Corporation
InventorsBaining Guo, Lin Liang, Heung-Yeung Shum, Ying-Qing Xu
Life of this patent
Estimating the term…
Abstract
The present invention involves a new system and method for synthesizing textures from an input sample. A system and method according to the present invention uses a unique accelerated patch-based sampling system to synthesize high-quality textures in real-time using a small input texture sample. The patch-based sampling system of the present invention works well for a wide variety of textures ranging from regular to stochastic. Potential feature mismatches across patch boundaries are avoided by sampling patches according to a non-parametric estimation of the local conditional Markov Random Field (MRF) density function.
Claims36
A system for automatically synthesizing image textures from an input image texture comprising:
- randomly selecting an initial texture patch from an input image texture;
- pasting the initial texture patch into an output texture;
- populating a set of texture patches from the input image texture, wherein the set is comprised of texture patches sampled from the input image texture, and wherein the set is populated with texture patches having boundary zones matching overlapping regions of the output texture where a next patch will be pasted;
- randomly selecting a texture patch from the set of texture patches;
- pasting the randomly selected texture patch into the output image;
- continuing to generate a new set of matching texture patches sampled from the input image texture and randomly selecting and pasting one patch from each new set of matching texture patches until the output texture is filled with texture patches.
A computer-implemented process for synthesizing image textures in real-time, comprising:
- determining an approximate scale of texture elements within an input texture;
- defining texture patch parameters as a function of the scale of texture elements within the input texture;
- using the texture patch parameters to define a texture patch size;
- randomly sampling a texture patch of the defined size from an input texture and pasting the randomly sampled texture patch into an output texture;
- searching within the input texture to identify a set of texture patches having boundary zones matching overlapping regions of the output texture where a next patch will be pasted;
- pasting a texture patch into the output image, wherein the pasted texture patch is randomly selected from the set of texture patches;
- continuing to perform new searches of the input texture to identify new sets of texture patches, and randomly selecting and pasting one patch from each new set until the output texture is filled with texture patches.
A computer-readable medium having computer executable instructions for automatically synthesizing an output image texture from an input image texture, said computer executable instructions comprising:
- pasting an initial randomly sampled texture patch from an input texture into an output texture;
- using a quad-tree pyramid for searching within the input texture to identify a set of texture patches having boundary zones matching overlapping regions of the output texture corresponding to a location where a next texture patch will be pasted;
- pasting the next texture patch into the output image, wherein the next texture patch is randomly selected from the set of texture patches;
- continuing to perform new quad-tree pyramid searches of the input texture to identify new sets of texture patches having boundary zones matching overlapping regions of the output texture, and randomly selecting and pasting one patch from each new set into the output texture until the output texture is filled with texture patches.
Dependencies are inferred from the claim text.