Image processing device having depth map generating unit, image processing method and non-transitory computer readable recording medium

An image processing device, comprising:

• an image inputting unit configured to input a plurality of input images with respect to a same scene;
• a feature detecting unit configured to detect a predetermined feature from the scene;
• a depth map generating unit configured to generate a depth map based on the predetermined feature detection result by the feature detecting unit,
• a detection unit configured to detect a person or a face in at least one of the plurality of input images;
• an image generating unit configured to generate an image in which a pixel at a depth corresponding to the detected person or the detected face looks in focus and other pixels look out of focus;
• a display unit configured to display the image generated by the image generating unit;
• a display controlling unit configured to control the display unit to display an adjuster image for enabling adjustment of an in-focus degree of the image generated according to focusing distance by an user operation;
• and
• an image adjustment unit configured to adjust the in-focus degree of the image generated using the depth map according to the adjuster image with respect to the user operation.

An image processing method, comprising:

• inputting a plurality of input images with respect to a same scene;
• displaying a reference image which is one of the plurality of input images or an image created based on the plurality of input image;
• detecting a predetermined feature from the plurality of input images;
• generating a depth map based on the predetermined feature detection result;
• receiving a first user operation selecting an area in the scene;
• reflecting to the reference image, information regarding depth of a pixel determined according to the area selected by the first user operation, using the depth map, wherein the step of displaying the reference image comprises:
• displaying an adjuster image for enabling adjustment of an in-focus degree of the reference image according to focusing distance by a second user operation;
• and
• adjusting the in-focus degree of the reference image using the depth map according to the adjuster image with respect to the second user operation.

A non-transitory computer readable recording medium storing a program to make a computer execute the steps of:

• an input step of inputting a plurality of input images with respect to a same scene;
• a displaying step of displaying a reference image which is one of the plurality of input images or an image created based on the plurality of input image;
• a detecting step of detecting a predetermined feature from the plurality of input images;
• a generating step of generating a depth map based on the predetermined feature detection result;
• a receiving step of receiving a first user operation selecting an area in the scene;
• a reflecting step of reflecting to the reference image, information regarding depth of a pixel determined according to the area selected by the first user operation, using the depth map, wherein the displaying step comprises:
• displaying an adjuster image for enabling adjustment of an in-focus degree of the reference image according to focusing distance by a second user operation;
• and
• an adjusting step of adjusting the in-focus degree of the reference image using the depth map according to the adjuster image with respect to the second user operation.