# US 10,771,754 B2 · Image white balance correction method and electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,771,754 B2
- Document ID: US10771754B2
- Status: Granted
- Kind: B2
- Application number: 16/345,893
- Filed: 2017-12-06
- Published: 2019-09-19
- Granted: 2020-09-08
- Earliest claimed: 2016-12-14
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Tsuyoshi Moriya
- Web page: https://patentgrep.com/patent/US10771754B2

## CPC

- G03B 15/05: Combinations of cameras with electronic flash apparatus; Electronic flash units
- G03B 7/091: Digital circuits
- G03B 15/03: Combinations of cameras with lighting apparatus; Flash units
- H04N 1/6086: {by scene illuminant, i.e. conditions at the time of picture capture, e.g. flash, optical filter used, evening, cloud, daylight, artificial lighting, white point measurement, colour temperature}
- H04N 9/646: {for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters}
- H04N 23/10: for generating image signals from different wavelengths
- H04N 23/70: Circuitry for compensating brightness variation in the scene
- H04N 23/75: by influencing optical camera components
- H04N 23/88: for colour balance, e.g. white-balance circuits or colour temperature control
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Provided is a method of correcting a white balance (WB) of an image includes obtaining a first image captured by photographing a subject when a flash emits light, and a second image captured by photographing the subject when the flash emits no light; obtaining a WB gain of the first image and a WB gain of the second image; obtaining a color balance (CB) of flash light, based on at least one of the obtained WB gains of the first and second images; and correcting a WB of the first image, based on the CB of the flash light.

## Claims

### Claim 1

A method of correcting a white balance (WB) of an image, the method comprising:
obtaining a first image captured by photographing a subject when a flash emits light, and a second image captured by photographing the subject when the flash emits no light;
obtaining a WB gain of the first image and a WB gain of the second image;
obtaining a color balance (CB) of flash light representing a strength of each color component of the flash by:
obtaining a first luminance value corresponding to the first image and a second luminance value corresponding to the second image based on an exposure control value of each of the first image and the second image, wherein the exposure control value includes an aperture value, a shutter velocity, or sensor sensitivity;
obtaining a first luminance difference corresponding to the first image and a second luminance difference corresponding to the second image based on color components of each of the first image and the second image;
obtaining a first representative luminance value corresponding to the first image, based on a sum of the first luminance value and the first luminance difference;
obtaining a second representative luminance value corresponding to the second image, based on a sum of the second luminance value and the second luminance difference;
obtaining an influence of the flash light on the first image based on the first representative luminance value and the second representative luminance value; and
obtaining the CB of the flash light, based on the influence of the flash light on the first image and the obtained WB gains of the first and second images; and
correcting a WB of the first image, based on the CB of the flash light.

### Claim 2 (depends on 1)

The method of claim 1, wherein the correcting of the WB of the first image comprises:
obtaining a WB gain for correcting the WB of the first image; and
correcting the WB of the first image, based on the obtained WB gain for correcting the WB of the first image.

### Claim 3 (depends on 1)

The method of claim 1, wherein the obtaining of the CB of the flash light comprises:
obtaining a CB of a light source having the flash light in addition to ambient light, based on the WB gain of the first image;
obtaining a CB of the ambient light, based on the WB gain of the second image; and
obtaining the CB of the flash light, based on at least one of the CB of the light source having the flash light in addition to the ambient light and the CB of the ambient light.

### Claim 4 (depends on 1)

The method of claim 1, wherein the correcting of the WB of the first image comprises:
splitting the first image and the second image into one or more blocks;
obtaining luminance values for the one or more blocks, in the first image and the second image;
obtaining at least one difference between luminance values of the first image and the second image, in the one or more blocks; and
correcting the WB of the first image, based on at least one of the at least one difference between the luminance values, the CB of the flash light, and the WB gain of the first image.

### Claim 5 (depends on 4)

The method of claim 4, wherein the correcting of the WB of the first image comprises:
obtaining a representative value for the at least one difference between the luminance values; and
correcting the WB of the first image, based on at least one of a CB of the flash light to which a weight proportional to the representative value has been applied and a WB gain of the first image to which a weight inversely proportional to the representative value has been applied.

### Claim 6 (depends on 1)

A non-transitory computer-readable recording medium having recorded thereon a program, which, when executed by a computer, performs the method of claim 1.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
splitting the first image into a first plurality of blocks corresponding to a first plurality of luminance values and the second image into a second plurality of blocks corresponding to a second plurality of luminance values;
obtaining a dispersion value representing a difference between the first plurality of luminance values and the second plurality of luminance values; and
correcting the WB of the first image based on at least the dispersion value and the CB of the flash light.

### Claim 8

An electronic device comprising:
an image obtainer configured to obtain a first image captured by photographing a subject when a flash emits light, and a second image captured by photographing the subject when the flash emits no light;
a memory storing the first image and the second image; and
at least one controller configured to
obtain a white balance (WB) gain of the first image and a WB gain of the second image;
obtain a color balance (CB) of flash light representing a strength of each color component of the flash by:
obtaining a first luminance value corresponding to the first image and a second luminance value corresponding to the second image based on an exposure control value of each of the first image and the second image, wherein the exposure control value includes an aperture value, a shutter velocity, or sensor sensitivity;
obtaining a first luminance difference corresponding to the first image and a second luminance difference corresponding to the second image based on color components of each of the first image and the second image;
obtaining a first representative luminance value corresponding to the first image, based on a sum of the first luminance value and the first luminance difference;
obtaining a second representative luminance value corresponding to the second image, based on a sum of the second luminance value and the second luminance difference;
obtaining an influence of the flash light on the first image based on the first representative luminance value and the second representative luminance value; and
obtaining the CB of the flash light, based on the influence of the flash light on the first image and the obtained WB gains of the first and second images; and
correct a WB of the first image, based on the CB of the flash light.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the at least one controller is configured to obtain a WB gain for correcting the WB of the first image, and to correct the WB of the first image, based on the obtained WB gain for corresponding the WB of the first image.

### Claim 10 (depends on 8)

The electronic device of claim 8, wherein the at least one controller is configured to split the first image and the second image into one or more blocks, obtain luminance values for the one or more blocks, in the first image and the second image, obtain at least one difference between luminance values of the first image and the second image, in the one or more blocks, and correct the WB of the first image, based on at least one of the at least one difference between the luminance values, the CB of the flash light, and the WB gain of the first image.

### Claim 11 (depends on 10)

The electronic device of claim 10, wherein the at least one controller is configured to:
obtain a representative value for the at least one difference between the luminance values; and
correct the WB of the first image, based on at least one of a CB of the flash light to which a weight proportional to the representative value has been applied and a WB gain of the first image to which a weight inversely proportional to the representative value has been applied.

### Claim 12 (depends on 8)

The electronic device of claim 8, further comprising a display displaying a first image of which a WB has been corrected based on the CB of the flash light.
