Image processing apparatus and image pickup apparatus where image processing is applied using an acquired depth map

An image pickup apparatus comprising an imaging unit and an image processing apparatus, wherein

• the image processing apparatus comprises:
• a depth map acquiring unit configured to acquire a depth map that records information indicating a depth distance corresponding to each point on a photographed image that is photographed by the imaging unit;
• an in-focus position acquiring unit configured to acquire an in-focus position on the photographed image without an indication representing the in-focus position from a user;
• a reference distance determining unit configured to acquire a depth distance corresponding to the in-focus position from the depth map and sets the acquired depth distance as a reference distance;
• and
• an image processing unit configured to perform image processing on the photographed image using the depth map and the reference distance.

An image processing method in which an image processing apparatus executes the steps of:

• acquiring a depth map that records information indicating a depth distance corresponding to each point on a photographed image;
• acquiring an in-focus position on the photographed image without an indication representing the in-focus position from a user;
• acquiring a depth distance corresponding to the in-focus position from the depth map and setting the acquired depth distance as a reference distance;
• and
• performing image processing on the photographed image using the depth map and the reference distance.

A non-transitory computer readable storage medium storing a program that causes an image processing apparatus to execute the respective steps of acquiring a depth map that records information indicating a depth distance corresponding to each point on a photographed image;

• acquiring an in-focus position on the photographed image without an indication representing the in-focus position from a user;
• acquiring a depth distance corresponding to the in-focus position from the depth map and setting the acquired depth distance as a reference distance;
• and
• performing image processing on the photographed image using the depth map and the reference distance.

An image processing apparatus comprising:

• a depth map acquiring unit configured to acquire a depth map that records information indicating a depth distance corresponding to each point on a photographed image;
• an in-focus position acquiring unit configured to acquire an in-focus position on the photographed image without an indication representing the in-focus position from a user;
• and
• a reference distance determining unit configured to acquire a depth distance corresponding to the in-focus position from the depth map and sets the acquired depth distance as a reference distance.

An image processing apparatus comprising at least one processor and at least one memory, coupled to each other and operating to:

• acquire a depth map that records information indicating a depth distance corresponding to each point on a photographed image;
• acquire an in-focus position on the photographed image without an indication representing the in-focus position from a user;
• acquire a depth distance corresponding to the in-focus position from the depth map and sets the acquired depth distance as a reference distance;
• and
• perform image processing on the photographed image using the depth map and the reference distance.