Image processing apparatus, image pickup apparatus, image processing method, and non-transitory computer-readable storage medium that correct a parallax image based on a correction value calculated using a captured image

An image pickup apparatus comprising:

• (A) an image pickup element including a plurality of arrayed pixels that include a plurality of photoelectric converters that receive light beams passing through partial pupil regions in an imaging optical system, the partial pupil regions being different from each other;
• (B) a memory storing instructions;
• (C) one or more processors that execute the instructions stored in the memory;
• and
• (D) an image processing circuit that, based on the instructions executed by the one or more processors, is configured to function as:
• (a) an acquisition unit configured to acquire (i) a parallax image generated based on a signal from one of the plurality of photoelectric converters, and (ii) a captured image generated by combining signals from the plurality of photoelectric converters;
• (b) a determination unit configured to determine whether the parallax image contains a defect;
• (c) an image processing unit configured (i) to calculate a correction value by using pixel values of the captured image corresponding to the defect determined by the determination unit, and (ii) to correct one or more pixel values of the parallax image that include the defect with the corresponding correction value;
• and
• (d) a storage unit configured to store the parallax image corrected by the image processing unit in a storage medium.

An image processing method comprising the steps of:

• acquiring (i) a parallax image generated based on a signal from one of a plurality of photoelectric converters that receive light beams passing through partial pupil regions of an imaging optical system different from each other, and (ii) a captured image generated by combining a plurality of signals from the plurality of photoelectric converters;
• determining whether the parallax image contains a defect;
• calculating a correction value by using pixel values of the captured image corresponding to the defect determined by the determining;
• correcting one or more pixel values of the parallax image that include the defect with the corresponding correction value;
• and
• storing the parallax image corrected by the correcting in a storage medium.

A non-transitory computer-readable storage medium storing a program that causes a computer to execute an image processing method comprising the steps of:

• acquiring (i) a parallax image generated based on a signal from one of a plurality of photoelectric converters that receive light beams passing through partial pupil regions of an imaging optical system different from each other, and (ii) a captured image generated by combining a plurality of signals from the plurality of photoelectric converters;
• determining whether the parallax image contains a defect;
• calculating a correction value by using the pixel values of the captured image corresponding to the defect determined by the determining;
• correcting one or more pixel values of the parallax image with the corresponding correction value;
• and
• storing the parallax image corrected by correcting in a storage medium.