System and method for image-based surface detail transfer
AssigneeMicrosoft Corporation
InventorsZhengyou Zhang, Zicheng Liu, Ying Shan
Life of this patent
Estimating the term…
Abstract
A system and method, called Image-Based Surface Detail Transfer, to transfer geometric details from one surface of an object in an image to another with simple 2D image operations. The basic observation is that, without knowing its 3D geometry, geometric details (local deformations) can be extracted from a single image of an object in a way independent of its surface reflectance, and furthermore, these geometric details can be transferred to modify the appearance of other objects directly in images. Examples are shown including surface detail transfer between real objects, as well as between real and synthesized objects.
Claims19
A computer-implemented process for transferring geometrical details from a first object in one image to a second object in a second image, comprising using a computer to perform the following process actions:
- inputting a first image depicting an object whose surface details are to be transferred and a second image depicting an object of similar shape as depicted in the first image;
- aligning the objects of similar shape in first and second images;
- computing a smoothed version of the first and second images;
- for each pixel in the first aligned image, computing the ratio of the original intensity to the smoothed intensity;
- creating a new image by multiplying the ratio of the original intensity to the smoothed intensity of the first image by the smoothed intensity for each corresponding point in the second image.
A system for simulating the appearance of a face at a different age, the system comprising:
- a general purpose computing device;
- and
- a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to,
- input a first image depicting a face whose facial characteristics are to be transferred and a second image depicting an face that is to receive the facial characteristics of the face in the first face;
- align the faces in first and second images;
- compute a smoothed version of the faces in the first and second images;
- for each pixel in the face of the first aligned image, compute the ratio of the original intensity to the smoothed intensity;
- and
- create a new image by multiplying the ratio of the original intensity to the smoothed intensity of the face in the first image by the smoothed intensity for each corresponding point in the second image.
A computer-readable medium having computer-executable instructions for transferring the surface details of an object in one image to an object of similar shape in another image, said computer executable instructions comprising:
- recording a first image depicting an object whose surface details are to be transferred and a second image depicting an object of similar shape as depicted in the first image;
- smoothing first and second images;
- for each pixel in the first image, computing the ratio of the original intensity to the smoothed intensity;
- and
- creating a new image by multiplying the ratio of the original intensity to the smoothed intensity of the first image by the smoothed intensity for each corresponding point in the second image.
Dependencies are inferred from the claim text.