Image processing device and image processing method for calculating distance information to a subject

An image processing method that uses a plurality of images respectively having focusing positions different from each other to calculate distance information to a subject,

• the image processing method comprising:
• converting the plurality of images into frequency;
• extracting an amplitude component out of a phase component and the amplitude component of a coefficient obtained by converting the plurality of images into frequency;
• and
• calculating the distance information, by using lens blur data and only the amplitude component extracted out of the phase component and the amplitude component of the coefficient,
• wherein the calculating of the distance information includes:
• calculating a cost of a distance assumed for the plurality of images, based on a depth calculation formula, by using the lens blur data and the amplitude component extracted, an image deviation being applied to one of the plurality of images and introduced into the depth calculation formula;
• and
• determining the distance information, by using the cost of the distance calculated.

An image processing device that uses a plurality of images respectively having focusing positions different from each other to calculate distance information to a subject, the image processing device comprising:

• a frequency converter that converts the plurality of images into frequency;
• an amplitude extractor that extracts an amplitude component out of a phase component and the amplitude component of a coefficient obtained by converting the plurality of images into frequency;
• a distance information calculator that calculates the distance information, by using lens blur data and only the amplitude component extracted by the amplitude extractor out of the phase component and the amplitude component of the coefficient, and outputs the calculated distance information for controlling a lens system of a camera in capturing of images;
• an area divider that divides one image of the plurality of images into a plurality of first small areas;
• and
• an area searcher that searches for a second small area corresponding to each of the plurality of first small areas, for another image of the plurality of images,
• wherein the frequency converter converts an image of each of the plurality of first small areas, and an image of the second small area corresponding to each of the plurality of first small areas into frequency,
• the amplitude extractor extracts the amplitude component, for each of the plurality of first small areas, and the second small area corresponding to each of the plurality of first small areas, and
• the distance information calculator calculates the distance information, for each of the plurality of first small areas,
• wherein the distance information calculator includes:
• a cost calculator that calculates a cost of a distance assumed for the plurality of images, based on a depth calculation formula, by using the lens blur data and the amplitude component extracted by the amplitude extractor, an image deviation being applied to one of the plurality of images and introduced into the depth calculation formula;
• and
• a distance determiner that determines the distance information, by using the cost of the distance calculated by the cost calculator.