Back to results
US 11,388,383 B2Granted
Image processing apparatus, image pickup apparatus, image processing method, and non-transitory computer-readable storage medium
AssigneeCanon Kabushiki Kaisha
InventorKoichi Fukuda
Life of this patent
Estimating the term…
Abstract
An image processing apparatus includes an acquisition unit which acquires a parallax image generated based on a signal of a photoelectric converter among a plurality of photoelectric converters which receive light beams passing through partial pupil regions of an imaging optical system different from each other, and acquires a captured image generated by combining signals of the plurality of photoelectric converters, and an image processing unit which performs correction process so as to reduce a defect included in the parallax image based on the captured image.
Claims24
An image processing apparatus comprising:
- (A) a memory storing instructions;
- (B) one or more processors that execute the instructions stored in the memory;
- and
- (C) an image processing circuit that, based on the instructions executed by the one or more processors, is configured to function as:
- (a) an acquisition unit configured to acquire (i) a parallax image generated based on a signal from one of a plurality of photoelectric converters corresponding to a same microlens from an image pickup element, wherein the image pickup element includes a plurality of pixels that includes the plurality of photoelectric converters, and wherein each of the plurality of pixels corresponds to a respective one of a plurality of microlenses, and (ii) a composite image generated by combining a plurality of signals from the plurality of photoelectric converters;
- (b) an image processing unit configured (i) to calculate a correction value by using pixel values of the composite image corresponding to a defect, and (ii) to correct one or more pixel values of the parallax image that include the defect with the corresponding correction value;
- and
- (c) a storage unit configured to store in a storage medium the parallax image corrected by the image processing unit.
5 more elements
An image pickup apparatus comprising:
- (A) an image pickup element including a plurality of arrayed pixels that include a plurality of photoelectric converters that receive light beams passing through partial pupil regions in an imaging optical system which forms an optical image on the image pickup element, the partial pupil regions being different from each other;
- (B) a memory storing instructions;
- (C) one or more processors that execute the instructions stored in the memory;
- and
- (D) an image processing circuit that, based on the instructions executed by the one or more processors, is configured to function as:
- (a) an acquisition unit configured to acquire (i) a parallax image generated based on a signal from one of the plurality of photoelectric converters corresponding to a same microlens from the image pickup element, wherein the image pickup element includes a plurality of pixels that includes the plurality of photoelectric converters, and wherein each of the plurality of pixels corresponds to a respective one of a plurality of microlenses, and (ii) a composite image generated by combining signals from the plurality of photoelectric converters;
- (b) an image processing unit configured (i) to calculate a correction value by using pixel values of the composite image corresponding to a defect, and (ii) to correct one or more pixel values of the parallax image that include the defect with the corresponding correction value;
- and
- (c) a storage unit configured to store in a storage medium the parallax image corrected by the image processing unit.
6 more elements
An image processing method comprising the steps of:
- acquiring (i) a parallax image generated based on a signal from one of a plurality of photoelectric converters corresponding to a same microlens from an image pickup element, wherein the image pickup element includes a plurality of pixels that includes the plurality of photoelectric converters, and wherein each of the plurality of pixels corresponds to a respective one of a plurality of microlenses, and (ii) a composite image generated by combining a plurality of signals from the plurality of photoelectric converters;
- calculating a correction value by using signals pixel values of the composite image corresponding to a defect;
- correcting one or more pixel values of the parallax image that include the defect with the corresponding correction value;
- and
- storing in a storage medium the parallax image corrected by the correcting.
2 more elements
A non-transitory computer-readable storage medium storing a program that causes a computer to execute an image processing method comprising the steps of:
- acquiring (i) a parallax image generated based on a signal from one of a plurality of photoelectric converters corresponding to a same microlens from an image pickup element, wherein the image pickup element includes a plurality of pixels that includes the plurality of photoelectric converters, and wherein each of the plurality of pixels corresponds to a respective one of a plurality of microlenses, and (ii) a composite image generated by combining a plurality of signals from the plurality of photoelectric converters;
- calculating a correction value by using the pixel values of the composite image corresponding to a defect;
- correcting one or more pixel values of the parallax image with the corresponding correction value;
- and
- storing in a storage medium the parallax image corrected by correcting.
2 more elements
Dependencies are inferred from the claim text.