Image processing apparatus, image processing method and non-transitory computer-readable storage medium

An image processing method comprising:

• obtaining (a) a captured image including a plurality of pixels, and (b) first distance information relating to a distance from an in-focus plane and corresponding to each of the plurality of pixels;
• deriving evaluation values that indicate an accuracy of the first distance information for each of the plurality of pixels, based on values of the plurality of pixels included in the obtained captured image;
• dividing the obtained captured image into a plurality of divided areas based on the evaluation values;
• and
• generating second distance information for each of the plurality of divided areas,
• wherein the dividing divides the obtained captured image into the plurality of divided areas so that (a) a pixel density in an area of the captured image is determined, excluding any pixel the evaluation value of which does not exceed a threshold, and (b) in the dividing, a fineness of division of the area of the captured image is determined in accordance with the pixel density.

A non-transitory computer-readable storage medium storing a program which, when executed by processor of a computer, causes the processor to function as a plurality of units comprising:

• (1) an obtainment unit configured to obtain (a) a captured image including a plurality of pixels, and (b) first distance information relating to a distance from an in-focus plane and corresponding to each of the plurality of pixels;
• (2) a deriving unit configured to derive evaluation values that indicate an accuracy of the first distance information for each of the plurality of pixels, based on values of the plurality of pixels included in the obtained captured image;
• (3) a division unit configured to divide the obtained captured image into a plurality of divided areas based on the evaluation values;
• and
• (4) a generation unit configured to generate second distance information for each of the plurality of divided areas,
• wherein the division unit divides the obtained captured image into the plurality of divided areas so that (a) a pixel density in an area of the captured image is determined, excluding any pixel the evaluation value of which does not exceed a threshold, and (b) in the dividing, a fineness of division of the area of the captured image is determined in accordance with the pixel density.