Image processing device, imaging device, image processing method, and non-transitory computer readable medium

An image processing method of processing a captured image signal output from an imaging element including a plurality of capturing pixels and a plurality of phase difference detecting pixels, the image processing method comprising:

• an image processing step of correcting an output signal of the phase difference detecting pixel included in the captured image signal captured by the imaging element through one of gain correction processing of performing a correction by multiplying the output signal by a gain value and interpolation correction processing of performing a correction by replacing the output signal with a signal generated based on output signals of capturing pixels adjacent to the phase difference detecting pixel and detecting the same color as a color of the phase difference detecting pixel, and of recording the captured image signal after the correction in a recording medium,
• wherein within a range including a correction target phase difference detecting pixel and a plurality of capturing pixels adjacent to the correction target phase difference detecting pixel and detecting the same color as a color of the correction target phase difference detecting pixel, when a minimum value is Smin, a maximum value is Smax, a value obtained by subtracting a first value from the minimum value Smin is TH1, a value obtained by adding a second value to the maximum value Smax is TH2, and a signal value obtained by correcting an output signal of the correction target phase difference detecting pixel through the gain correction processing is Sc among the output signals of the capturing pixels, in a case in which Sc<TH1 or Sc>TH2, the image processing operation step includes recording, in the recording medium, a signal obtained by correcting the output signal of the correction target phase difference detecting pixel through the interpolation correction processing, and the first and second values are based on a value of the output signal of the correction target phase difference detecting pixel and the gain value.

A non-transitory computer readable medium storing an image processing program causing a computer to perform processing a captured image signal output from an imaging element including a plurality of capturing pixels and a plurality of phase difference detecting pixels, the processing comprising:

• an image processing step of correcting an output signal of the phase difference detecting pixel included in the captured image signal captured by the imaging element through one of gain correction processing of performing a correction by multiplying the output signal by a gain value and interpolation correction processing of performing a correction by replacing the output signal with a signal generated based on output signals of capturing pixels adjacent to the phase difference detecting pixel and detecting the same color as a color of the phase difference detecting pixel, and of recording the captured image signal after the correction in a recording medium,
• wherein within a range including a correction target phase difference detecting pixel and a plurality of capturing pixels adjacent to the correction target phase difference detecting pixel and detecting the same color as a color of the correction target phase difference detecting pixel, when a minimum value is Smin, a maximum value is Smax, a value obtained by subtracting a first value from the minimum value Smin is TH1, a value obtained by adding a second value to the maximum value Smax is TH2, and a signal value obtained by correcting an output signal of the correction target phase difference detecting pixel through the gain correction processing is Sc among the output signals of the capturing pixels, in a case in which Sc<TH1 or Sc>TH2, the image processing operation step includes recording, in the recording medium, a signal obtained by correcting the output signal of the correction target phase difference detecting pixel through the interpolation correction processing, and
• the first and second values are based on a value of the output signal of the correction target phase difference detecting pixel and the gain value.

An image processing device processing a captured image signal output from an imaging element including a plurality of capturing pixels and a plurality of phase difference detecting pixels, the image processing device comprising:

• a gain correction processing unit that performs gain correction processing of correcting an output signal of the phase difference detecting pixel included in the captured image signal captured by the imaging element by multiplying the output signal by a gain value;
• an interpolation correction processing unit that performs interpolation correction processing by replacing the output signal of the phase difference detecting pixel included in the captured image signal with a signal generated based on output signals of capturing pixels adjacent to the phase difference detecting pixel and detecting the same color as a color of the phase difference detecting pixel;
• and
• an image processing unit that corrects each output signal of the plurality of phase difference detecting pixels using one of the gain correction processing unit and the interpolation correction processing unit, and record the captured image signal after the correction in a recording medium,
• wherein within a range including a correction target phase difference detecting pixel and a plurality of capturing pixels adjacent to the correction target phase difference detecting pixel and detecting the same color as a color of the correction target phase difference detecting pixel, when a minimum value is Smin, a maximum value is Smax, a value obtained by subtracting a first value from the minimum value Smin is TH1, a value obtained by adding a second value to the maximum value Smax is TH2, and a signal value obtained by correcting an output signal of the correction target phase difference detecting pixel through the gain correction processing is Sc among the output signals of the capturing pixels, in a case in which TH1≦Sc<Smin or Smax<Sc≦TH2, the image processing unit records, in the recording medium, a signal obtained by correcting the output signal of the correction target phase difference detecting pixel using the interpolation correction processing unit,
• the first and second values are based on a value of the output signal of the correction target phase difference detecting pixel and the gain value, and
• the interpolation correction processing performed by the interpolation correction processing unit is processing of replacing the output signal of the phase difference detecting pixel with the minimum value Smin or the maximum value Smax within the range.