Image processing apparatus, method and program

An image processing apparatus comprising:

• skin-tone image area detecting means for detecting a skin-tone image area, which is contained in an image represented by applied image data, based upon image shape or image structure;
• gray pixel detecting means for detecting gray pixels contained in the image represented by the image data based upon color information obtained from pixels that constitute the skin-tone image area that has been detected by said skin-tone image area detecting means;
• color temperature estimating means for estimating color temperature of a photographic light source based upon gray pixels that have been detected by said gray pixel detecting means;
• color temperature range narrowing means which, based upon the color information obtained from the pixels that constitute the skin-tone image area detected by said skin-tone image area detecting means, is for narrowing a range of color temperatures of a photographic light source that are to be possessed by gray pixels to be detected;
• said gray pixel detecting means adopting pixels, which possess color temperatures that fall within the range of color temperatures narrowed by said color temperature range narrowing means, as detection candidates, and detecting gray pixels from among these detection candidates;
• wherein said color temperature range narrowing means includes:
• a first coefficient multiplying means for multiplying a representative value of color information, which is obtained from the pixels that constitute the skin-tone image area that has been detected by said skin-tone image area detecting means, by each of a plurality of prescribed coefficients;
• a first chromaticity value converting means for converting a plurality of the coefficient-multiplied skin-tone-area representative values, which have been calculated by said first coefficient multiplying means, to representative chromaticity values;
• and
• coefficient range searching means for searching for a range of the prescribed coefficients used in calculation of the coefficient-multiplied skin-tone-area representative chromaticity values, these prescribed coefficients being such that distances between the plurality of coefficient-multiplied skin-tone-area representative chromaticity values obtained by said first chromaticity value converting means to a value on the skin-tone—blackbody locus nearest a skin-tone-area representative chromaticity value obtained by conversion, to a chromaticity value, of a representative value of color information obtained from the pixels that constitute the skin-tone image area, will fall within a prescribed distance.

An image processing apparatus comprising:

• skin-tone image area detecting means for detecting a skin-tone image area, which is contained in an image represented by applied image data, based upon image shape or image structure;
• gray pixel detecting means for detecting gray pixels contained in the image represented by the image data based upon color information obtained from pixels that constitute the skin-tone image area that has been detected by said skin-tone image area detecting means;
• and
• color temperature estimating means for estimating color temperature of a photographic light source based upon gray pixels that have been detected by said gray pixel detecting means;
• wherein said color temperature range narrowing means includes:
• a first coefficient multiplying means for multiplying a representative value of color information, which is obtained from the pixels that constitute the skin-tone image area that has been detected by said skin-tone image area detecting means, by each of a plurality of prescribed coefficients;
• a first chromaticity value converting means for converting a plurality of the coefficient-multiplied skin-tone-area representative values, which have been calculated by said first coefficient multiplying means, to representative chromaticity values;
• and
• weighting means for calculating distances between the plurality of coefficient-multiplied skin-tone-area representative chromaticity values obtained by said first coefficient converting means, and a value on the skin-tone—blackbody locus nearest a skin-tone-area representative chromaticity value obtained by conversion, to a chromaticity value, of a representative value of color information obtained from the pixels that constitute the skin-tone image area, and weighting each of the plurality of prescribed coefficients in accordance with the distances calculated;
• and
• said gray pixel detecting means includes:
• a second coefficient multiplying means for multiplying a representative value of color temperature obtained from the pixels that constitute the skin-tone image area by the prescribed coefficients;
• a second chromaticity value converting means for converting the coefficient-multiplied skin-tone-area representative value, which has been calculated by said second coefficient multiplying means, to a representative chromaticity value;
• determination means for determining whether the coefficient-multiplied skin-tone-area representative chromaticity value obtained by said second chromaticity value converting means lies within a zone in the vicinity of the skin-tone—blackbody locus;
• provisional color temperature estimating means for estimating that a color temperature corresponding to a point on the skin-tone—blackbody locus nearest the coefficient-multiplied skin-tone-area representative chromaticity value is a provisional color temperature if said determination means has determined that the coefficient-multiplied skin-tone-area representative chromaticity value lies within the zone in the vicinity of the skin-tone—blackbody locus;
• third coefficient multiplying means for multiplying color information, which is obtained from the pixels that constitute the image represented by the image data, by prescribed coefficients that will cause the coefficient-multiplied skin-tone-area representative chromaticity value to fall within the zone in the vicinity of the skin-tone—blackbody locus;
• third chromaticity value converting means for converting a plurality of coefficient-multiplied pixel values, which have been obtained by said third coefficient multiplying means, to chromaticity values;
• wherein from among the pixels that constitute the image represented by the image data, there are specified pixels for which the coefficient-multiplied pixel chromaticity values obtained by said third chromaticity value converting means will fall within a zone in the vicinity of a point on a gray—blackbody locus corresponding to the provisional color temperature that has been estimated by said provisional color temperature estimating means, and the specific pixels are detected as gray pixels;
• means for calculating an evaluation function value based upon number of gray pixels detected by said gray pixel detecting means and weights of the prescribed coefficients used in said second and third coefficient calculating means, by using such an evaluation function that the larger the number of gray pixels detected by said gray pixel detecting means, the smaller the value of the function, and the larger the weight regarding the prescribed coefficients, the smaller the value of the function;
• and
• optimizing coefficient searching means for searching for prescribed coefficients for which the evaluation function value will be minimized;
• said second and third coefficient multiplying means using the prescribed coefficients found by said optimizing coefficient searching means.

An image processing apparatus comprising:

• skin-tone image area detecting means for detecting a skin-tone image area, which is contained in an image represented by applied image data, based upon image shape or image structure;
• gray pixel detecting means for detecting gray pixels contained in the image represented by the image data based upon color information obtained from pixels that constitute the skin-tone image area that has been detected by said skin-tone image area detecting means;
• color temperature estimating means for estimating color temperature of a photographic light source based upon gray pixels that have been detected by said gray pixel detecting means;
• color temperature range narrowing means which, based upon the color information obtained from the pixels that constitute the skin-tone image area detected by said skin-tone image area detecting means, is for narrowing a range of color temperatures of a photographic light source that are to be possessed by gray pixels to be detected;
• said gray pixel detecting means adopting pixels. which possess color temperatures that fall within the range of color temperatures narrowed by said color temperature range narrowing means, as detection candidates, and detecting gray pixels from among these detection candidates;
• wherein a first coefficient multiplying means for multiplying a representative value of color information, which is obtained from the pixels that constitute the skin-tone image area that has been detected by said skin-tone image area detecting means, by each of a plurality of prescribed coefficients;
• a first chromaticity value converting means for converting a plurality of the coefficient-multiplied skin-tone-area representative values, which have been calculated by said first coefficient multiplying means, to representative chromaticity values;
• and
• weighting means for calculating distances between the plurality of coefficient-multiplied skin-tone-area representative chromaticity values obtained by said first coefficient converting means, and a value on the skin-tone—blackbody locus nearest a skin-tone-area representative chromaticity value obtained by conversion, to a chromaticity value, of a representative value of color information obtained from the pixels that constitute the skin-tone image area, and weighting each of the plurality of prescribed coefficients in accordance with the distances calculated;
• and
• said gray pixel detecting means includes:
• a second coefficient multiplying means for multiplying a representative value of color temperature obtained from the pixels that constitute the skin-tone image area by the prescribed coefficients;
• a second chromaticity value converting means for converting the coefficient-multiplied skin-tone-area representative value, which has been calculated by said second coefficient multiplying means, to a representative chromaticity value;
• determination means for determining whether the coefficient-multiplied skin-tone-area representative chromaticity value obtained by said second chromaticity value converting means lies within a zone in the vicinity of the skin-tone—blackbody locus;
• provisional color temperature estimating means for estimating that a color temperature corresponding to a point on the skin-tone—blackbody locus nearest the coefficient-multiplied skin-tone-area representative chromaticity value is a provisional color temperature if said determination means has determined that the coefficient-multiplied skin-tone-area representative chromaticity value lies within the zone in the vicinity of the skin-tone—blackbody locus;
• a third coefficient multiplying means for multiplying color information, which is obtained from the pixels that constitute the image represented by the image data, by prescribed coefficients that will cause the coefficient-multiplied skin-tone-area representative chromaticity value to fall within the zone in the vicinity of the skin-tone—blackbody locus;
• a third chromaticity value converting means for converting a plurality of coefficient-multiplied pixel values, which have been obtained by said third coefficient multiplying means, to chromaticity values;
• wherein from among the pixels that constitute the image represented by the image data, there are specified pixels for which the coefficient-multiplied pixel chromaticity values obtained by said third chromaticity value converting means will fall within a zone in the vicinity of a point on a gray—blackbody locus corresponding to the provisional color temperature that has been estimated by said provisional color temperature estimating means, and the specific pixels are detected as gray pixels;
• means for calculating an evaluation function value based upon number of gray pixels detected by said gray pixel detecting means and weights of the prescribed coefficients used in said second and third coefficient calculating means, by using such an evaluation function that the larger the number of gray pixels detected by said gray pixel detecting means, the smaller the value of the function, and the larger the weight regarding the prescribed coefficients, the smaller the value of the function;
• and
• optimizing coefficient searching means for searching for prescribed coefficients for which the evaluation function value will be minimized;
• said second and third coefficient multiplying means using the prescribed coefficients found by said optimizing coefficient searching means.

An image processing method comprising the steps of:

• detecting a skin-tone image area, which is contained in an image represented by applied image data, based upon image shape or image structure;
• detecting gray pixels contained in the image represented by the image data based upon color information obtained from pixels that constitute the skin-tone image area that has been detected;
• and
• estimating color temperature of a photographic light source based upon gray pixels that have been detected;
• wherein the step of detecting gray pixels includes:
• multiplying a representative value of color information obtained from pixels constituting the skin-tone image area by prescribed coefficients;
• converting the coefficient-multiplied skin-tone-area representative value to a representative chromaticity value;
• determining whether the coefficient-multiplied skin-tone-area representative chromaticity value lies within a zone in the vicinity of a skin-tone—blackbody locus;
• estimating that a color temperature corresponding to a point on the skin-tone—blackbody locus nearest the coefficient-multiplied skin-tone-area representative chromaticity value is a provisional color temperature if it is determined that the coefficient-multiplied skin-tone-area representative chromaticity value lies within the zone in the vicinity of the skin-tone—blackbody locus;
• multiplying color information, which is obtained from each pixel constituting the image represented by the image data, by the prescribed coefficients that will cause the coefficient-multiplied skin-tone-area representative chromaticity value to fall within the zone in the vicinity of the skin-tone—blackbody locus;
• and
• converting a plurality of coefficient-multiplied pixel values to chromaticity values;
• wherein from among the pixels that constitute the image represented by the image data, there are specified pixels for which the coefficient-multiplied pixel chromaticity values will fall within a zone in the vicinity of a point on a gray—blackbody locus corresponding to the provisional color temperature that has been estimated, and the specific pixels are detected as gray pixels.

A computer-executable image processing program embodied in a computer readable medium for causing a computer to execute:

• skin-tone image area detection processing for detecting a skin-tone image area, which is contained in an image represented by applied image data, based upon image shape or image structure;
• gray pixel detection processing for detecting gray pixels contained in the image represented by the image data based upon color information obtained from pixels that constitute the skin-tone image area that has been detected by said skin-tone image area detection processing;
• and
• color temperature estimation processing for estimating color temperature of a photographic light source based upon gray pixels that have been detected by said gray pixel detection processing;
• wherein said gray pixel detection processing includes:
• first coefficient multiplication processing for multiplying a representative value of color information obtained from pixels constituting the skin-tone image area by prescribed coefficients;
• first chromaticity value conversion processing for converting the coefficient-multiplied skin-tone-area representative value, which has been calculated by said first coefficient multiplication processing, to a representative chromaticity value;
• determination processing for determining whether the coefficient-multiplied skin-tone-area representative chromaticity value obtained by said first chromaticity value conversion processing lies within a zone in the vicinity of a skin-tone—blackbody locus;
• provisional color temperature estimation processing for estimating that a color temperature corresponding to a point on the skin-tone—blackbody locus nearest the coefficient-multiplied skin-tone-area representative chromaticity value is a provisional color temperature if said determination processing has determined that the coefficient-multiplied skin-tone-area representative chromaticity value lies within the zone in the vicinity of the skin-tone—blackbody locus;
• second coefficient multiplication processing for multiplying color information, which is obtained from each pixel constituting the image represented by the image data, by the prescribed coefficients that will cause the coefficient-multiplied skin-tone-area representative chromaticity value to fall within the zone in the vicinity of the skin-tone—blackbody locus;
• and
• second chromaticity value conversion processing for converting a plurality of coefficient-multiplied pixel values, which have been obtained by said second coefficient multiplication processing, to chromaticity values;
• wherein from among the pixels that constitute the image represented by the image data, there are specified pixels for which the coefficient-multiplied pixel chromaticity values obtained by said second chromaticity value conversion processing will fall within a zone in the vicinity of a point on a gray—blackbody locus corresponding to the provisional color temperature that has been estimated by said provisional color temperature estimation processing, and the specific pixels are detected as gray pixels.

An image processing apparatus comprising:

• a skin-tone image area detector that detects a skin-tone image area, which is contained in an image represented by applied image data, based upon image shape or image structure;
• a gray pixel detector that detects gray pixels contained in the image represented by the image data based upon color information obtained from pixels that constitute the skin-tone image area that has been detected by said skin-tone image area detector;
• and
• a color temperature estimator that estimates color temperature of a photographic light source based upon gray pixels that have been detected by said gray pixel detector;
• wherein said gray pixel detector includes:
• a first coefficient multiplier that multiplies a representative value of color information obtained from pixels constituting the skin-tone image area by prescribed coefficients;
• a first chromaticity value converter that converts the coefficient-multiplied skin-tone-area representative value, which has been calculated by said first coefficient multiplier, to a representative chromaticity value;
• a determiner that determines whether the coefficient-multiplied skin-tone-area representative chromaticity value obtained by said first chromaticity value converter lies within a zone in the vicinity of a skin-tone—blackbody locus;
• a provisional color temperature estimator that estimates a color temperature corresponding to a point on the skin-tone—blackbody locus nearest the coefficient-multiplied skin-tone-area representative chromaticity value is a provisional color temperature if said determiner has determined that the coefficient-multiplied skin-tone-area representative chromaticity value lies within the zone in the vicinity of the skin-tone—blackbody locus;
• a second coefficient multiplier that multiplies color information, which is obtained from each pixel constituting the image represented by the image data, by the prescribed coefficients that will cause the coefficient-multiplied skin-tone-area representative chromaticity value to fall within the zone in the vicinity of the skin-tone—blackbody locus;
• and
• a second chromaticity value converter that converts a plurality of coefficient-multiplied pixel values, which have been obtained by said second coefficient multiplier, to chromaticity values;
• wherein from among the pixels that constitute the image represented by the image data, there are specified pixels for which the coefficient-multiplied pixel chromaticity values obtained by said second chromaticity value converter will fall within a zone in the vicinity of a point on a gray—blackbody locus corresponding to the provisional color temperature that has been estimated by said provisional color temperature estimator, and the specific pixels are detected as gray pixels.