# US 9,438,875 B2 · Image processing apparatus, image processing method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,438,875 B2 - Document ID: US9438875B2 - Status: Granted - Kind: B2 - Application number: 14/592,632 - Filed: 2015-01-08 - Published: 2015-04-30 - Granted: 2016-09-06 - Earliest claimed: 2010-09-02 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Yusuke Shimizu - Web page: https://patentgrep.com/patent/US9438875B2 ## CPC - H04N 9/646: {for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters} - H04N 1/6086: {by scene illuminant, i.e. conditions at the time of picture capture, e.g. flash, optical filter used, evening, cloud, daylight, artificial lighting, white point measurement, colour temperature} - H04N 5/265: Mixing - H04N 23/74: by influencing the scene brightness using illuminating means - H04N 23/88: for colour balance, e.g. white-balance circuits or colour temperature control - H04N 25/10: for transforming different wavelengths into image signals - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract The present invention generates first developed image data by correcting image data with use of a first white balance correction value corresponding to a first light source, generates second developed image data by correcting the image data with use of a second white balance correction value corresponding to a second light source, calculates a color evaluation value of each of blocks by adding and averaging color evaluation values of pixels in the image data for each of the divided blocks, calculates a combining ratio based on a difference between the calculated color evaluation value of each of the blocks and a color evaluation value of white under the second light source, and combines the first developed image data and the second developed image data according to the calculated combining ratio. ## Claims ### Claim 1 An image processing apparatus comprising: a generation unit configured to generate first developed image data by correcting an image data formed by an imaging unit with use of a first white balance correction value corresponding to a first light source, and generate second developed image data by correcting the image data formed by the imaging unit with use of a second white balance correction value corresponding to a second light source, wherein the first developed image data and the second developed image data are generated by correcting the same image data; a color evaluation value calculation unit configured to calculate a color evaluation value of each of the plurality areas in the image data; a combining ratio calculation unit configured to calculate a combining ratio based on the color evaluation value of each area, which is calculated by the color evaluation value calculation unit, relative to a color evaluation value of white under one of the light sources; and a combining unit configured to combine the first developed image data and the second developed image data according to the combining ratio. ### Claim 2 (depends on 1) The image processing apparatus according to claim 1, further comprising: a first determination unit configured to determine the first white balance correction value corresponding to the first light source from the image data; and a second determination unit configured to determine the second white balance correction value corresponding to the second light source from the image data. ### Claim 3 (depends on 2) The image processing apparatus according to claim 2, wherein the first determination unit determines the first white balance correction value based on white balance control using a blackbody locus. ### Claim 4 (depends on 2) The image processing apparatus according to claim 2, wherein the second determination unit determines the second white balance correction value with use of a value predetermined for each light source. ### Claim 5 (depends on 1) The image processing apparatus according to claim 1, wherein the combining unit does not perform the combining in a case where a light source for the image data cannot be determined. ### Claim 6 (depends on 1) The image processing apparatus according to claim 1, wherein the combining ratio calculation unit calculates a combining ratio of each pixel by interpolation processing. ### Claim 7 (depends on 1) The image processing apparatus according to claim 1, wherein, in a case where there is a saturated pixel, the color evaluation value calculation unit excludes a pixel value of the saturated pixel and a pixel value of a pixel of another color corresponding to the saturated pixel, from the calculation of a color average value. ### Claim 8 (depends on 4) The image processing apparatus according to claim 4, wherein the second determination unit determines the second white balance correction value to retain a tint of a light source. ### Claim 9 (depends on 1) The image processing apparatus according to claim 1, wherein the combining unit combines only color components of the first developed image data and the second developed image data. ### Claim 10 (depends on 1) The image processing apparatus according to claim 1, wherein the generation unit is configured to generate third developed image data by correcting the image data with use of a third white balance correction value corresponding to a third light source, and wherein the combining unit is configured to combine first, second and third developed image data. ### Claim 11 (depends on 10) The image processing apparatus according to claim 10, including second determination unit configured to determine the second and third white balance correction values corresponding to the second and third light sources from the image data, with use of a value predetermined for each light source. ### Claim 12 (depends on 1) The image processing apparatus according to claim 1, wherein the combining ratio calculation unit calculates the combining ratio based on a difference between the color evaluation value of each area in the image data and a color evaluation value of white under the second light source. ### Claim 13 An image processing method comprising: generating first developed image data by correcting the image data with use of a first white balance correction value corresponding to a first light source, and generating second developed image data by correcting the image data with use of a second white balance correction value corresponding to a second light source, wherein the first developed image data and the second developed image data are generated by correcting the same image data; calculating a color evaluation value of each of the plurality areas in the image data; calculating a combining ratio based on the calculated color evaluation value of each area relative to a color evaluation value of white under one of the light sources; and combining the first developed image data and the second developed image data according to the calculated combining ratio. ### Claim 14 (depends on 13) The image processing method according to claim 13, further comprising: determining the first white balance correction value corresponding to the first light source from the image data; and determining the second white balance correction value corresponding to the second light source from the image data. ### Claim 15 (depends on 13) The image processing method according to claim 13, calculating the combining ratio based on a difference between the color evaluation value of each area in the image data and a color evaluation value of white under the second light source. ### Claim 16 (depends on 13) A non-transitory computer-readable storage medium device storing a program comprising instructions which, when executed by a computer, cause the computer to perform the method of claim 13. ### Claim 17 An imaging apparatus comprising: an imaging unit to obtain an image data by capturing; a generation unit configured to generate first developed image data by correcting the image data with use of a first white balance correction value corresponding to a first light source, and generate second developed image data by correcting the image data with use of a second white balance correction value corresponding to a second light source, wherein the first developed image data and the second developed image data are generated by correcting the same image data; color evaluation value calculation unit configured to calculate a color evaluation value of each of the plurality areas in the image data; a combining ratio calculation unit configured to calculate a combining ratio based on the color evaluation value of each area which is calculated by the color evaluation value calculation unit relative to a color evaluation value of white under one of the light sources; and a combining unit configured to combine the first developed image data and the second developed image data according to the combining ratio.