Image Processing Apparatus, Image Processing Method, And Computer-Readable Media for Attaining Image Processing

An image processing method that receives mosaic image data having settings of only one color component, R, G, or B, in each pixel and subjects the received mosaic image data to a series of image processing to generate color image data with settings of all the three color components R, G, and B in each pixel, the image processing method comprising:

• receiving, as the mosaic image data, image data in the form of a Bayer color filter array;
• obtaining the G component and the another color component in each pixel included in each of the pixel columns of the mosaic image data, and computing a vertical-direction color difference component between the G component and the another color component in each pixel included in each of the pixel columns in the vertical direction;
• obtaining the G component and the another color component in each pixel included in each of the pixel rows of the mosaic image data, and computing a horizontal-direction color difference component between the G component and the another color component in each pixel included in each of the pixel rows in the horizontal direction;
• determining an edge direction in each pixel as any one of the vertical direction or the horizontal direction by selecting, from among the mosaic image data, a pixel of the R component or a pixel of the B component, and comparing a variation of the vertical-direction color difference component and a variation of the horizontal-direction color difference component of the selected pixel;
• interpolating a missing color component, which is a color component not set in the pixel for each pixel of the mosaic image data, on the basis of the color component set in the mosaic image data while referencing the edge direction;
• detecting an oblique edge pixel, of which the edge direction is oriented obliquely, by analyzing the image data in which the missing color component is interpolated;
• determining an oblique edge direction, which is the edge direction in the oblique edge pixel, on the basis of the vertical-direction color difference component and the horizontal-direction color difference component;
• and
• recalculating the interpolated color component in the oblique edge pixel on the basis of at least one of the mosaic image data, the vertical-direction color difference component and the horizontal-direction color difference component in a pixel placed in the oblique edge direction from the oblique edge pixel and then updating the interpolated color component with its recalculated variant to thereby correct the interpolated result in the oblique edge pixel.

One or more computer-readable media having computer-readable instructions thereon which, when executed, implement a method for receiving mosaic image data having settings of only one color component, R, G, or B, in each pixel and subjecting the received mosaic image data to a series of image processing to generate color image data with settings of all the three color components, R, G, and B, in each pixel, the method comprising:

• receiving, as the mosaic image data, image data in the form of a Bayer color filter array;
• obtaining the G component and the another color component in each pixel included in each of the pixel columns of the mosaic image data, and computing a vertical-direction color difference component between the G component and the another color component in each pixel included in each of the pixel columns in the vertical direction;
• obtaining the G component and the another color component in each pixel included in each of the pixel rows of the mosaic image data, and computing a horizontal-direction color difference component between the G component and the another color component in each pixel included in each of the pixel rows in the horizontal direction;
• determining an edge direction in each pixel as any one of the vertical direction or the horizontal direction by selecting, from among the mosaic image data, a pixel of the R component or a pixel of the B component, and comparing a variation of the vertical-direction color difference component and a variation of the horizontal-direction color difference component of the selected pixel;
• interpolating a missing color component, which is a color component not set in the pixel for each pixel of the mosaic image data, on the basis of the color component set in the mosaic image data while referencing the edge direction;
• detecting an oblique edge pixel, of which the edge direction is oriented obliquely, by analyzing the image data in which the missing color component is interpolated;
• determining an oblique edge direction, which is the edge direction in the oblique edge pixel, on the basis of the vertical-direction color difference component and the horizontal-direction color difference component;
• and
• recalculating the interpolated color component in the oblique edge pixel on the basis of at least one of the mosaic image data, the vertical-direction color difference component and the horizontal-direction color difference component in a pixel placed in the oblique edge direction from the oblique edge pixel and then updating the interpolated color component by the calculated missing color component to thereby correct the interpolated result in the oblique edge pixel.