# US 2020/0404235 A1 · Device for and method of correcting white balance of image

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404235 A1
- Document ID: US20200404235A1
- Status: Published application
- Kind: A1
- Application number: 16/904,707
- Filed: 2020-06-18
- Published: 2020-12-24
- Earliest claimed: 2019-06-20
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Tsuyoshi MORIYA
- Web page: https://patentgrep.com/patent/US20200404235A1

## CPC

- H04N 23/88: for colour balance, e.g. white-balance circuits or colour temperature control
- H04N 23/12: with one sensor only
- H04N 23/95: Computational photography systems, e.g. light-field imaging systems
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An electronic device includes a camera configured to capture an image and generate an electrical image signal by photoelectrically converting incident light, and at least one processor configured to estimate a light source color temperature based on image data of the image signal, identify a target coordinate on a color space based on the light source color temperature, identify a capture coordinate on the color space based on the image, identify a chrominance allowable range based on the target coordinate, obtain a white balance evaluation value based on a first distance between the target coordinate and the chrominance allowable range and a second distance between the capture coordinate and the chrominance allowable range, and perform a white balance correction on the image based on the white balance evaluation value.

## Claims

### Claim 1

An electronic device comprising:
a camera configured to capture an image and generate an image signal by photoelectrically converting incident light; and
at least one processor configured to:
estimate a light source color temperature based on image data of the image signal,
identify a target coordinate on a color space based on the light source color temperature,
identify a capture coordinate on the color space based on the image,
identify a chrominance allowable range based on the target coordinate,
obtain a white balance evaluation value based on a first distance between the target coordinate and the chrominance allowable range and a second distance between the capture coordinate and the chrominance allowable range, and
perform a white balance correction on the image based on the white balance evaluation value.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the chrominance allowable range is a region in the color space,
wherein the target coordinate is in the chrominance allowable range, and
wherein the at least one processor is further configured to identify a straight line connecting the target coordinate and the capture coordinate, and obtain the first distance between the target coordinate and the chrominance allowable range and the second distance between the capture coordinate and the chrominance allowable range on the straight line.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein the at least one processor is further configured to obtain the white balance evaluation value based on a ratio of the second distance to the first distance.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is further configured to:
identify a reference region in the image, and
estimate the light source color temperature based on image data of the reference region.

### Claim 5 (depends on 4)

The electronic device of claim 4, wherein the reference region is an achromatic region in the image including an achromatic color patch.

### Claim 6 (depends on 1)

The electronic device of claim 1, wherein the chrominance allowable range is identified such that a first diameter in a blue direction and an amber direction is longer than a second diameter in a light green direction and a magenta direction in the color space.

### Claim 7 (depends on 1)

The electronic device of claim 1, wherein the chrominance allowable range is identified in different ranges depending on the light source color temperature.

### Claim 8 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is further configured to, based on the chrominance allowable range being identified, identify, based on the target coordinate, a distance in the amber direction, a distance in the magenta direction, a distance in the blue direction, and a distance in the light green direction.

### Claim 9 (depends on 1)

The electronic device of claim 1, wherein the chrominance allowable range is identified by reflecting a plurality of evaluation scores with respect to white balance of the image.

### Claim 10 (depends on 1)

The electronic device of claim 1, wherein the color space comprises a CIE LAB color space including an L* axis corresponding to a reflectivity, an a* axis corresponding to a red direction and a green direction, and a b* axis corresponding to a yellow direction and a blue direction.

### Claim 11 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is further configured to identify whether a color of each region in the image is one from among an object color and a light source color, and perform the white balance correction based on the color of each region being one from among the object color and the light source color.

### Claim 12 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is further configured to:
divide the image into a plurality of blocks,
identify a type of an object in each of the plurality of blocks,
perform clustering to form at least one class corresponding to the type of the object, and
identify a white balance parameter value based on the white balance evaluation value and the at least one class.

### Claim 13 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is further configured to identify whether the capture coordinate is in the chrominance allowable range,
wherein, based on identifying that the capture coordinate is in the chrominance allowable range, identify the white balance evaluation value as 0, and
wherein, based on identifying that the capture coordinate is out of the chrominance allowable range, obtain the white balance evaluation value based on the first distance between the target coordinate and the chrominance allowable range and the second distance between the capture coordinate and the chrominance allowable range.

### Claim 14

An image processing method comprising:
estimating a light source color temperature based on image data of an image captured by a camera;
identifying a target coordinate on a color space based on the light source color temperature;
identifying a capture coordinate on the color space based on the image;
identifying a chrominance allowable range based on the target coordinate;
obtaining a white balance evaluation value based on a first distance between the target coordinate and the chrominance allowable range and a second distance between the capture coordinate and the chrominance allowable range; and
performing a white balance correction on the image based on the white balance evaluation value.

### Claim 15 (depends on 14)

The image processing method of claim 14, wherein the chrominance allowable range is a region in the color space,
wherein the target coordinate is in the chrominance allowable range, and
wherein the image processing method further comprises identifying a straight line connecting the target coordinate and the capture coordinate and obtaining the first distance between the target coordinate and the chrominance allowable range and the second distance between the capture coordinate and the chrominance allowable range on the straight line.

### Claim 16 (depends on 15)

The image processing method of claim 15, wherein the obtaining the white balance evaluation value comprises identifying the white balance evaluation value based on a ratio of the second distance to the first distance.

### Claim 17 (depends on 14)

The image processing method of claim 14, wherein the estimating the light source color temperature comprises:
identifying a reference region in the image, and
estimating the light source color temperature based on image data of the reference region.

### Claim 18 (depends on 17)

The image processing method of claim 17, wherein the reference region is an achromatic region in the image including an achromatic color patch.

### Claim 19 (depends on 14)

The image processing method of claim 14, wherein the chrominance allowable range is identified such that a first diameter in a blue direction and an amber direction is longer than a second in a light green direction and a magenta direction in the color space.

### Claim 20

A non-transitory computer-readable storage medium having stored therein a computer program for executing an image processing method, when executed by a processor, the processor is configured to:
estimate a light source color temperature based on image data of an image captured by a camera;
identify a target coordinate on a color space based on the light source color temperature;
identify a capture coordinate on the color space based on the image;
identify a chrominance allowable range based on the target coordinate;
obtain a white balance evaluation value based on a first distance between the target coordinate and the chrominance allowable range and a second distance between the capture coordinate and the chrominance allowable range; and
perform a white balance correction on the image based on the white balance evaluation value.
