Virtual image artifact detection
AssigneeMicrosoft Corporation
InventorsAndrew Blake, Antonio Criminisi
Life of this patent
Estimating the term…
Abstract
Artifacts are detected in a cyclopean virtual image generated from stereo images. A disparity map is generated from the stereo images. Individual projected images are determined based on the disparity map and the corresponding stereo images. A difference map is computed between the individual projected images to indicate the artifacts. A source patch in the virtual image is defined relative to an artifact. A replacement target patch is generated using a split-patch search technique as a composite of a background exemplar patch and a foreground exemplar patch. Each exemplar patch may be identified from an image patch selected from at least one of the stereo images. The source patch of the virtual image is replaced by the replacement target patch to correct the detected artifact.
Claims26
A method of detecting one or more artifacts in a virtual image synthesized from stereo images, the method comprising:
- generating a disparity map from the stereo images;
- generating a projected image for each of the stereo images by projecting each stereo image into a target viewpoint based on the disparity map;
- computing color-distances between corresponding pixels in the projected images to produce a difference map;
- and
- designating one or more locations in the difference map associated with a computed color-distance exceeding a threshold as the one or more artifacts.
A computer readable medium encoded with a computer program for executing on a computer system a computer process for detecting one or more artifacts in a virtual image synthesized from stereo images, the computer process comprising:
- generating a projected image for each of the stereo images by projecting each stereo image into a target viewpoint based on a disparity map of the stereo images;
- computing differences between corresponding pixels in the projected images to produce a difference map, wherein a computed difference exceeding a threshold indicates an artifact;
- generating an occlusion man from the stereo images;
- and
- combining the occlusion man into the projected image.
A system for detecting one or more artifacts in a virtual image synthesized from stereo images, the system comprising:
- an image warp module that generates a projected image for each of the stereo images by projecting each stereo image into a target viewpoint based on a disparity map of the stereo images;
- an image distancing module that computes color-distances between corresponding pixels in the projected images to produce a difference map;
- and
- a thresholding module that designates one or more locations in the difference map associated with a computed color-distance exceeding a threshold as the one or more artifacts.
A computer readable medium encoded with a computer program for executing on a computer system a computer process for detecting one or more artifacts in a virtual image synthesized from stereo images, the computer process comprising:
- generating a projected image for each of the stereo images by projecting each stereo image into a target viewpoint based on a disparity map of the stereo images;
- computing differences between corresponding pixels in the projected images to produce a difference map, wherein a computed difference exceeding a threshold indicates an artifact;
- identifying an artifact pixel in the virtual image that corresponds with one of the artifacts;
- defining a source patch relative to the artifact pixel in the virtual image;
- identifying a disparity point in the disparity map that corresponds to the artifact pixel;
- defining a disparity patch relative to the disparity point in the disparity map;
- and
- generating a filter map from the source patch and the disparity patch.
A computer readable medium encoded with a computer program for executing on a computer system a computer process for detecting one or more artifacts in a virtual image synthesized from stereo images, the computer process comprising:
- generating a projected image for each of the stereo images by projecting each stereo image into a target viewpoint based on a disparity man of the stereo images;
- computing differences between corresponding pixels in the projected images to produce a difference map, wherein a computed difference exceeding a threshold indicates an artifact;
- generating a filter map from a source patch of the virtual image and a disparity patch of the disparity map;
- and
- determining a candidate exemplar patch from each stereo image based on the filter map.
Dependencies are inferred from the claim text.