Image processing apparatus, image processing method, and program

An image processing method that is executed by an image processing apparatus, wherein the image processing apparatus includes:

• a first polarizing unit that has a first polarization region and a second polarization region to transmit different polarized light corresponding to different viewing point images;
• a second polarizing unit that causes transmission light of the first polarizing unit to be incident and includes a third polarization region to transmit only the transmission light of the first polarization region, a fourth polarization region to transmit only transmission light of the second polarization region, and a total transmission region to transmit the transmission light of the first polarization region and the second polarization region;
• an imaging element that receives the transmission light of the second polarizing unit;
• and an image processing unit that executes signal processing with respect to an output signal of the imaging element, wherein the image processing method comprises operating the image processing unit of the image processing apparatus to carry out acts of:
• performing parallax detection processing for applying two different viewing point images of an image based on the transmission light of the third polarization region of the second polarizing unit and an image based on the transmission light of the fourth polarization region of the second polarizing unit and generating parallax information in which an object distance is reflected;
• generating reflection information which is determination information on whether a reflection light component is included in each pixel value, in units of polarization region pixels (PL pixels);
• selecting reference pixels according to the reflection information;
• applying pixels values of the selected reference pixels;
• executing pixel value interpolation processing of the polarization region pixels (PL pixels);
• and
• performing parallax image generation processing for applying the parallax information generated by the parallax detection processing.

At least one non-transitory computer-readable storage medium having encoded thereon executable instructions that, when executed by at least one processor, cause the at least one processor to carry out a method of operating an image processing apparatus that includes a first polarizing unit that has a first polarization region and a second polarization region to transmit different polarized light corresponding to different viewing point images;

• a second polarizing unit that causes transmission light of the first polarizing unit to be incident and includes a third polarization region to transmit only the transmission light of the first polarization region, a fourth polarization region to transmit only transmission light of the second polarization region, and a total transmission region to transmit the transmission light of the first polarization region and the second polarization region;
• an imaging element that receives the transmission light of the second polarizing unit;
• and an image processing unit that executes signal processing with respect to an output signal of the imaging element, wherein the method comprises operating the image processing unit of the image processing apparatus to carry out acts of:
• performing parallax detection processing for applying two different viewing point images of an image based on the transmission light of the third polarization region of the second polarizing unit and an image based on the transmission light of the fourth polarization region of the second polarizing unit and generating parallax information in which an object distance is reflected;
• generating reflection information, which is determination information on whether a reflection light component is included in each pixel value, in units of polarization region pixels (PL pixels);
• selecting reference pixels according to the reflection information;
• applying pixel values of the selected reference pixels;
• executing pixel value interpolation processing of the polarization region pixels (PL pixels);
• and
• performing parallax image generation processing for applying the parallax information generated by the parallax detection processing.