Back to results
US 7,689,036 B2Granted
Correction of blotches in component images
AssigneesWarner Bros. Entertainment Inc., AOL Inc.
InventorsKeren O. Perlmutter, Sharon M. Perlmutter
Life of this patent
Estimating the term…
Abstract
Blotches may be identified and processed to reduce or eliminate the blotch. The blotch may be in just one of several separations and multiple separations may be used, for example, to identify the blotch. An implementation (i) compares a first component image of an image with a first component image of a reference image, (ii) compares a second component image of the image with a second component image of the reference image, and (iii) determines based on these comparisons whether the first component image of the image includes a blotch. Multiple image separations also, or alternatively, may be used, for example, to modify the blotch, as well as to evaluate whether a modification is beneficial.
Claims30
A method of processing images containing a blotch, the method comprising:
- using at least one processor to perform operations comprising:
- accessing one or more component images of a target image, the target image including a first component image and a second component image;
- accessing one or more component images of a reference image, the reference image including a first component image and a second component image;
- determining a motion vector characterizing motion between the target image and the reference image;
- comparing, based on motion indicated by the motion vector, the first component image of the target image with the first component image of the reference image to produce a first-component comparison result;
- comparing, based on motion indicated by the motion vector, the second component image of the target image with the second component image of the reference image to produce a second-component comparison result;
- and
- determining that the first component image of the target image includes a blotch based on the first-component comparison result and the second-component comparison result,
- wherein comparing the first component image of the target image with the first component image of the reference image comprises determining a first-component difference between intensities of (i) a given pixel having a given location in the first component image of the target image and (ii) a corresponding pixel in the first component image of the reference image, the corresponding pixel in the first component image of the reference image being determined based on motion indicated by the motion vector,
- wherein comparing the second component image of the target image with the second component image of the reference image comprises determining a second-component difference between intensities of (i) a pixel having the given location in the second component image of the target image and (ii) a corresponding pixel in the second component image of the reference image, the corresponding pixel in the second component image of the reference image being determined based on motion indicated by the motion vector, and
- wherein determining that the first component image of the target image includes the blotch comprises identifying the given pixel as being part of the blotch based on the first-component difference and the second-component difference.
8 more elements
A method of processing images containing a blotch, the method comprising:
- using at least one processor to perform operations comprising:
- accessing one or more component images of a target image, the target image including a first component image and a second component image;
- accessing one or more component images of a reference image, the reference image including a first component image and a second component image;
- determining a motion vector characterizing motion between the target image and the reference image;
- comparing, based on motion indicated by the motion vector, the first component image of the target image with the first component image of the reference image to produce a first-component comparison result;
- comparing, based on motion indicated by the motion vector, the second component image of the target image with the second component image of the reference image to produce a second-component comparison result;
- and
- determining that the first component image of the target image includes a blotch based on the first-component comparison result and the second-component comparison result,
- wherein determining the motion vector comprises:
- determining a first value for first-component distortion characterizing distortion in the first component image of the target image associated with applying a first candidate motion vector to the first component image of the target image;
- determining a first value for second-component distortion characterizing distortion in the second component image of the target image associated with applying the first candidate motion vector to the second component image of the target image;
- determining a first value for a distortion function characterizing distortion from multiple component images of the target image associated with applying the first candidate motion vector to the multiple component images of the target image;
- determining a second value for first-component distortion characterizing distortion in the second component image of the target image associated with applying a second candidate motion vector to the first component image of the target image;
- determining a second value for second-component distortion characterizing distortion in the second component image of the target image associated with applying the second candidate motion vector to the second component image of the target image;
- determining a second value for the distortion function characterizing distortion from multiple component images of the target image associated with applying the second candidate motion vector to the multiple component images of the target image;
- and
- evaluating the second candidate motion vector based on the relative values of the first and second values of (1) first-component distortion, (2) second-component distortion, and (3) the distortion function.
14 more elements
A method of processing images containing a blotch, the method comprising:
- using at least one processor to perform operations comprising:
- accessing one or more component images of a target image, the target image including a first component image and a second component image;
- accessing one or more component images of a reference image, the reference image including a first component image and a second component image;
- determining a motion vector characterizing motion between the target image and the reference image;
- comparing, based on motion indicated by the motion vector, the first component image of the target image with the first component image of the reference image to produce a first-component comparison result;
- comparing, based on motion indicated by the motion vector, the second component image of the target image with the second component image of the reference image to produce a second-component comparison result;
- determining that the first component image of the target image includes a blotch based on the first-component comparison result and the second-component comparison result;
- and
- testing the motion vector using the second component image of the target image,
- wherein testing the motion vector using the second component image of the target image comprises:
- determining an extent of the blotch in the first component image of the target image;
- applying the motion vector to pixels in a corresponding extent of a digital representation of the second component image of the target image, the corresponding extent including pixels that correspond to the determined extent of the blotch;
- determining a blotch distortion value for the application of the motion vector to the pixels in the corresponding extent;
- determining a region in the first component image of the target image that includes more than the determined extent of the blotch;
- applying the motion vector to pixels in the digital representation of the second component image of the target image that are in a corresponding region but not in the corresponding extent, the corresponding region includes pixels that correspond to the determined region;
- determining a non-blotch distortion value for the application of the motion vector to pixels that are in the corresponding region but not in the corresponding extent;
- and
- evaluating the motion vector based on the blotch distortion value and the non-blotch distortion value.
15 more elements
A method of processing images containing a blotch, the method comprising:
- using at least one processor to perform operations comprising:
- accessing one or more component images of a target image, the target image including a first component image and a second component image;
- accessing one or more component images of a reference image, the reference image including a first component image and a second component image;
- determining a motion vector characterizing motion between the target image and the reference image;
- comparing, based on motion indicated by the motion vector, the first component image of the target image with the first component image of the reference image to produce a first-component comparison result;
- comparing, based on motion indicated by the motion vector, the second component image of the target image with the second component image of the reference image to produce a second-component comparison result;
- determining that the first component image of the target image includes a blotch based on the first-component comparison result and the second-component comparison result;
- performing a spatial correction in the first component image of the target image to modify the blotch;
- applying the spatial correction to the second component image of the target image;
- determining a spatial-correction distortion value for the application of the spatial correction to the second component image of the target image;
- comparing the spatial-correction distortion value to a spatial-correction distortion threshold;
- and
- evaluating the spatial correction of the first component image of the target image based on a result obtained from comparing the spatial-correction distortion value to the spatial-correction distortion threshold,
- wherein determining the spatial-correction distortion value comprises determining a distortion value between (1) the second component image of the target image before applying the spatial correction and (2) the second component image of the target image after applying the spatial correction.
11 more elements
A method of processing images containing a blotch, the method comprising:
- using at least one processor to perform operations comprising:
- accessing one or more component images of a target image, the target image including a first component image and a second component image;
- accessing one or more component images of a reference image, the reference image including a first component image and a second component image;
- determining a motion vector characterizing motion between the target image and the reference image;
- comparing, based on motion indicated by the motion vector, the first component image of the target image with the first component image of the reference image to produce a first-component comparison result;
- comparing, based on motion indicated by the motion vector, the second component image of the target image with the second component image of the reference image to produce a second-component comparison result;
- determining that the first component image of the target image includes a blotch based on the first-component comparison result and the second-component comparison result;
- performing a correction in the first component image of the target image to modify the blotch;
- and
- evaluating the correction using the second component image of the target image,
- wherein evaluating the correction using the second component image of the target image comprises:
- determining a first-component distortion value characterizing distortion from performing the correction in the first component image of the target image;
- performing the correction in the second component image of the target image;
- determining a second-component distortion value characterizing distortion from performing the correction in the second component image of the target image;
- comparing the first-component distortion value with the second-Component distortion value to produce a result;
- and
- evaluating the correction in the first component image of the target image based on the result.
14 more elements
A method of processing images containing a blotch, the method comprising:
- using at least one processor to perform operations comprising:
- accessing one or more component images of a target image, the target image including a first component image and a second component image;
- accessing one or more component images of a reference image, the reference image including a first component image and a second component image;
- determining a motion vector characterizing motion between the target image and the reference image;
- comparing, based on motion indicated by the motion vector, the first component image of the target image with the first component image of the reference image to produce a first-component comparison result;
- comparing, based on motion indicated by the motion vector, the second component image of the target image with the second component image of the reference image to produce a second-component comparison result;
- determining that the first component image of the target image includes a blotch based on the first-component comparison result and the second-component comparison result;
- determining an extent of the blotch in the first component image of the target image;
- determining a corresponding extent in the first component image of the reference image that corresponds to the extent of the blotch in the first component image of the target image;
- modifying the blotch in the first component image of the target image using information from the corresponding extent in the first component image of the reference image;
- determining a region in the first component image of the target image that includes more than the determined extent of the blotch;
- determining a blotch distortion value for the determined region that includes the modification of the blotch in the first component image of the target image;
- determining a corresponding extent in the second component image of the target image that corresponds to the extent in the first component image of the target image;
- determining a corresponding extent in the second component image of the reference image that corresponds to the extent in the first component image of the target image;
- modifying the corresponding extent in the second component image of the target image using information from the corresponding extent in the second component image of the reference image;
- determining a corresponding region in the second component image of the target image that corresponds to the determined region;
- determining a corresponding-region distortion value for the corresponding region that includes the modification of the corresponding extent in the second component image of the target image;
- and
- evaluating the modification of the blotch in the first component image of the target image based on the blotch distortion value and the corresponding-region distortion value.
16 more elements
An apparatus for processing images containing a blotch, the apparatus comprising:
- at least one processor;
- and
- at least one computer-readable medium coupled to the at least one processor having instructions stored thereon which, when executed by the at least one processor, causes the at least one processor to perform operations comprising:
- accessing one or more component images of a target image, the target image including a first component image and a second component image;
- accessing one or more component images of a reference image, the reference image including a first component image and a second component image;
- determining a motion vector characterizing motion between the target image and the reference image;
- comparing, based on motion indicated by the motion vector, the first component image of the target image with the first component image of the reference image to produce a first-component comparison result;
- comparing, based on motion indicated by the motion vector, the second component image of the target image with the second component image of the reference image to produce a second-component comparison result;
- and
- determining that the first component image of the target image includes a blotch based on the first-component comparison result and the second-component comparison result,
- wherein comparing the first component image of the target image with the first component image of the reference image comprises determining a first-component difference between intensities of (i) a given pixel having a given location in the first component image of the target image and (ii) a corresponding pixel in the first component image of the reference image, the corresponding pixel in the first component image of the reference image being determined based on motion indicated by the motion vector,
- wherein comparing the second component image of the target image with the second component image of the reference image comprises determining a second-component difference between intensities of (i) a pixel having the given location in the second component image of the target image and (ii) a corresponding pixel in the second component image of the reference image, the corresponding pixel in the second component image of the reference image being determined based on motion indicated by the motion vector, and
- wherein determining that the first component image of the target image includes the blotch comprises identifying the given pixel as being part of the blotch based on the first component difference and the second-component difference.
10 more elements
An apparatus for processing images containing a blotch, the apparatus comprising:
- at least one processor:
- and
- at least one computer-readable medium coupled to the at least one processor having instructions stored thereon which, when executed by the at least one processor, causes the at least one processor to perform operations comprising:
- accessing one or more component images of a target image, the target image including a first component image and a second component image;
- accessing one or more component images of a reference image, the reference image including a first component image and a second component image;
- determining a motion vector characterizing motion between the target image and the reference image;
- comparing, based on motion indicated by the motion vector, the first component image of the target image with the first component image of the reference image to produce a first-component comparison result;
- comparing, based on motion indicated by the motion vector, the second component image of the target image with the second component image of the reference image to produce a second-component comparison result;
- and
- determining that the first component image of the target image includes a blotch based on the first-component comparison result and the second-component comparison result,
- wherein determining the motion vector comprises:
- determining a first value for first-component distortion characterizing distortion in the first component image of the target image associated with applying a first candidate motion vector to the first component image of the target image;
- determining a first value for second-component distortion characterizing distortion in the second component image of the target image associated with applying the first candidate motion vector to the second component image of the target image;
- determining a first value for a distortion function characterizing distortion from multiple component images of the target image associated with applying the first candidate motion vector to the multiple component images of the target image;
- determining a second value for first-component distortion characterizing distortion in the second component image of the target image associated with applying a second candidate motion vector to the first component image of the target image;
- determining a second value for second-component distortion characterizing distortion in the second component image of the target image associated with applying the second candidate motion vector to the second component image of the target image;
- determining a second value for the distortion function characterizing distortion from multiple component images of the target image associated with applying the second candidate motion vector to the multiple component images of the target image;
- and
- evaluating the second candidate motion vector based on the relative values of the first and second values of (1) first-component distortion, (2) second-component distortion, and (3) the distortion function.
16 more elements
An apparatus for processing images containing a blotch, the apparatus comprising:
- at least one processor;
- and
- at least one computer-readable medium coupled to the at least one processor having instructions stored thereon which, when executed by the at least one processor, causes the at least one processor to perform operations comprising:
- accessing one or more component images of a target image, the target image including a first component image and a second component image;
- accessing one or more component images of a reference image, the reference image including a first component image and a second component image;
- determining a motion vector characterizing motion between the target image and the reference image;
- comparing, based on motion indicated by the motion vector, the first component image of the target image with the first component image of the reference image to produce a first-component comparison result;
- comparing, based on motion indicated by the motion vector, the second component image of the target image with the second component image of the reference image to produce a second-component comparison result;
- determining that the first component image of the target image includes a blotch based on the first-component comparison result and the second-component comparison result;
- and
- testing the motion vector using the second component image of the target image,
- wherein testing the motion vector using the second component image of the target image comprises:
- determining an extent of the blotch in the first component image of the target image;
- applying the motion vector to pixels in a corresponding extent of a digital representation of the second component image of the target image, the corresponding extent including pixels that correspond to the determined extent of the blotch;
- determining a blotch distortion value for the application of the motion vector to the pixels in the corresponding extent;
- determining a region in the first component image of the target image that includes more than the determined extent of the blotch;
- applying the motion vector to pixels in the digital representation of the second component image of the target image that are in a corresponding region but not in the corresponding extent, the corresponding region includes pixels that correspond to the determined region;
- determining a non-blotch distortion value for the application of the motion vector to pixels that are in the corresponding region but not in the corresponding extent;
- and
- evaluating the motion vector based on the blotch distortion value and the non blotch distortion value.
17 more elements
An apparatus for processing images containing a blotch, the apparatus comprising:
- at least one processor;
- and
- at least one computer-readable medium coupled to the at least one processor having instructions stored thereon which, when executed by the at least one processor, causes the at least one processor to perform operations comprising:
- accessing one or more component images of a target image, the target image including a first component image and a second component image;
- accessing one or more component images of a reference image, the reference image including a first component image and a second component image;
- determining a motion vector characterizing motion between the target image and the reference image;
- comparing, based on motion indicated by the motion vector, the first component image of the target image with the first component image of the reference image to produce a first-component comparison result;
- comparing, based on motion indicated by the motion vector, the second component image of the target image with the second component image of the reference image to produce a second-component comparison result;
- determining that the first component image of the target image includes a blotch based on the first-component comparison result and the second-component comparison result;
- performing a spatial correction in the first component image of the target image to modify the blotch;
- applying the spatial correction to the second component image of the target image;
- determining a spatial-correction distortion value for the application of the spatial correction to the second component image of the target image;
- comparing the spatial-correction distortion value to a spatial-correction distortion threshold;
- and
- evaluating the spatial correction of the first component image of the target image based on a result obtained from comparing the spatial-correction distortion value to the spatial-correction distortion threshold,
- wherein determining the spatial-correction distortion value comprises determining a distortion value between (1) the second component image of the target image before applying the spatial correction and (2) the second component image of the target image after applying the spatial correction.
13 more elements
An apparatus for processing images containing a blotch, the apparatus comprising:
- at least one processor;
- and
- at least one computer-readable medium coupled to the at least one processor having instructions stored thereon which, when executed by the at least one processor, causes the at least one processor to perform operations comprising:
- accessing one or more component images of a target image, the target image including a first component image and a second component image;
- accessing one or more component images of a reference image, the reference image including a first component image and a second component image;
- determining a motion vector characterizing motion between the target image and the reference image;
- comparing, based on motion indicated by the motion vector, the first component image of the target image with the first component image of the reference image to produce a first-component comparison result;
- comparing, based on motion indicated by the motion vector, the second component image of the target image with the second component image of the reference image to produce a second-component comparison result;
- determining that the first component image of the target image includes a blotch based on the first-component comparison result and the second-component comparison result;
- performing a correction in the first component image of the target image to modify the blotch;
- and
- evaluating the correction using the second component image of the target image,
- wherein evaluating the correction using the second component image of the target image comprises:
- determining a first-component distortion value characterizing distortion from performing the correction in the first component image of the target image;
- performing the correction in the second component image of the target image;
- determining a second-component distortion value characterizing distortion from performing the correction in the second component image of the target image;
- comparing the first-component distortion value with the second-component distortion value to produce a result;
- and
- evaluating the correction in the first component image of the target image based on the result.
16 more elements
An apparatus for processing images containing a blotch, the apparatus comprising:
- at least one processor;
- and
- at least one computer-readable medium coupled to the at least one processor having instructions stored thereon which, when executed by the at least one processor, causes the at least one processor to perform operations comprising:
- accessing one or more component images of a target image, the target image including a first component image and a second component image;
- accessing one or more component images of a reference image, the reference image including a first component image and a second component image;
- determining a motion vector characterizing motion between the target image and the reference image;
- comparing, based on motion indicated by the motion vector, the first component image of the target image with the first component image of the reference image to produce a first-component comparison result;
- comparing, based on motion indicated by the motion vector, the second component image of the target image with the second component image of the reference image to produce a second-component comparison result;
- determining that the first component image of the target image includes a blotch based on the first-component comparison result and the second-component comparison result;
- determining an extent of the blotch in the first component image of the target image;
- determining a corresponding extent in the first component image of the reference image that corresponds to the extent of the blotch in the first component image of the target image;
- modifying the blotch in the first component image of the target image using information from the corresponding extent in the first component image of the reference image;
- determining a region in the first component image of the target image that includes more than the determined extent of the blotch;
- determining a blotch distortion value for the determined region that includes the modification of the blotch in the first component image of the target image;
- determining a corresponding extent in the second component image of the target image that corresponds to the extent in the first component image of the target image;
- determining a corresponding extent in the second component image of the reference image that corresponds to the extent in the first component image of the target image;
- modifying the corresponding extent in the second component image of the target image using information from the corresponding extent in the second component image of the reference image;
- determining a corresponding region in the second component image of the target image that corresponds to the determined region;
- determining a corresponding-region distortion value for the corresponding region that includes the modification of the corresponding extent in the second component image of the target image;
- and
- evaluating the modification of the blotch in the first component image of the target image based on the blotch distortion value and the corresponding-region distortion value.
18 more elements
Dependencies are inferred from the claim text.