Image processing method, image processing apparatus, storage medium, manufacturing method of learned model, and image processing system

An image processing apparatus comprising:

• at least one processor;
• and
• at least one memory coupled to the at least one processor storing instructions that, when executed by the at least one processor, cause the at least one processor to function as:
• an acquiring unit configured to acquire a first image having disparity information and refocus information;
• and
• a generating unit configured to input the first image or the disparity information and the refocus information into a machine learning model, and to generate a second image having an in-focus position different from an in-focus position of the first image based on the refocus information,
• wherein the refocus information is information on a distance between the in-focus position of the first image and the in-focus position of the second image.

A generating method of a learned model, the manufacturing method comprising the steps of:

• a first step of acquiring a first image having disparity information and a ground truth image;
• a second step of acquiring refocus information on a distance between an in-focus position of the first image and an in-focus position of the ground truth image;
• and
• a third step of learning a machine learning model using the ground truth image and a second image generated by inputting the first image or the disparity information and the refocus information into the machine learning model,
• wherein the third step inputs the first image or the disparity information into the machine learning model, generates the second image having an in-focus position different from an in-focus position of the first image based on the refocus information, and learns the machine learning model based on an error between the second image and the ground truth image.