Image processing apparatus, image processing method, imaging apparatus, and recording medium

An image processing apparatus which performs a plurality of gradation processes on image data, the image processing apparatus comprising:

• one or more processors;
• and
• a memory storing instructions which, when the instructions are executed by the one or more processors, cause the image processing apparatus to function as:
• an acquisition unit configured to acquire a plurality of pieces of visual point image data having different visual points;
• a first processing unit configured to generate image data in which a dynamic range is extended using the plurality of pieces of visual point image data;
• a second processing unit configured to determine a saturation level of a color signal of the image data and generate image data having the extended dynamic range;
• and
• a combination unit configured to combine images generated by the first and second processing units,
• wherein the acquisition unit acquires first image data from a first photoelectric conversion unit and acquires second image data obtained by adding the first image data and image data acquired from a second photoelectric conversion unit, the first photoelectric conversion unit and the second photoelectric conversion unit being configured to receive light passing through different pupil areas of an imaging optical system, and
• wherein the second processing unit calculates a saturation level of a color signal associated with the second image data and determines whether to perform a replacement process of the color signal from a color signal value and the saturation level for each pixel, and performs the replacement process of the color signal using color difference information of the first image data when performing the replacement process.