Image processing apparatus, image processing method, and program

A control method of an image pickup apparatus having ordinary pixels arranged in a horizontal direction and a vertical direction and functional pixels arranged discretely between the ordinary pixels, comprising:

• a first estimating step of performing a gain correction operation to outputs of the functional pixels, thereby estimating an image signal at a position of the functional pixel;
• a second estimating step of selecting a plurality of reference pixels from the ordinary pixels around the functional pixel and estimating the image signal at the position of the functional pixel on basis of outputs of the plurality of selected reference pixels;
• and
• a selecting step of selecting the image signal at the position of the functional pixel on the basis of an output in the first estimating step and from one or a plurality of estimation results which are obtained in the second estimating step on the basis of combinations of the plurality of selected reference pixels.

A non-transitory computer-readable storage medium storing program codes for allowing a computer to execute a control method of an image pickup apparatus having ordinary pixels arranged in a horizontal direction and a vertical direction and functional pixels arranged discretely between the ordinary pixels, wherein the control method comprises:

• a step of reading out outputs of the ordinary pixels and the functional pixels from the image pickup element;
• a first estimating step of performing a gain correction operation to the output of the functional pixel, thereby estimating an image signal at a position of the functional pixel;
• a second estimating step of selecting a plurality of reference pixels from the ordinary pixels around the functional pixel and estimating of the image signal at the position of the functional pixel on the basis of outputs of the plurality of selected reference pixels;
• and
• a selecting step of selecting the image signal at the position of the functional pixel on the basis of an output in the first estimating step and from one or a plurality of estimation results which are obtained in the second estimating step on the basis of combinations of the plurality of selected reference pixels.