Image processing apparatus and image processing method

An image processing apparatus comprising:

• a color information input unit configured to input color information of each pixel of an image of interest that is one of a plurality of images included in a multi-viewpoint image;
• a distance information input unit configured to input distance information from a viewpoint for each pixel of each image included in the multi-viewpoint image;
• a reliability derivation unit configured to derive, for each pixel of the image of interest as a pixel of interest, a reliability of the distance information of the pixel of interest based on the distance information of the pixel of interest in the image of interest and distance information of the pixel corresponding to the pixel of interest in another image included in the multi-viewpoint image;
• a parameter derivation unit configured to derive, for each pixel of the image of interest, a parameter concerning a type of a region for the pixel based on the color information and the distance information of the pixel and the reliability of the distance information obtained by said reliability derivation unit;
• and
• a determination unit configured to determine a foreground region in the image using the derived parameter for each pixel of the image.

An image processing method comprising:

• inputting color information of each pixel of the image;
• inputting distance information from a viewpoint for each pixel of the image;
• deriving, for each pixel of the image as a pixel of interest, a reliability of the distance information of the pixel of interest based on the color information and the distance information of the pixel of interest and a neighbor pixel of the pixel of interest;
• deriving, for each pixel of the image, a parameter concerning a type of a region for the pixel based on the color information and the distance information of the pixel and the reliability of the distance information obtained in the deriving the reliability;
• and
• determining a foreground region in the image using the derived parameter for each pixel of the image.

An image processing method comprising:

• inputting color information of each pixel of an image of interest that is one of a plurality of images included in a multi-viewpoint image;
• inputting distance information from a viewpoint for each pixel of each image included in the multi-viewpoint image;
• deriving, for each pixel of the image of interest as a pixel of interest, a reliability of the distance information of the pixel of interest based on the distance information of the pixel of interest in the image of interest and distance information of the pixel corresponding to the pixel of interest in another image included in the multi-viewpoint image;
• deriving, for each pixel of the image of interest, a parameter concerning a type of a region for the pixel based on the color information and the distance information of the pixel and the reliability of the distance information obtained in the deriving the reliability;
• and
• determining a foreground region in the image using the derived parameter for each pixel of the image.