# US 2012/0249844 A1 · Image processing apparatus and method of controlling the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0249844 A1
- Document ID: US20120249844A1
- Status: Published application
- Kind: A1
- Application number: 13/415,393
- Filed: 2012-03-08
- Published: 2012-10-04
- Earliest claimed: 2011-03-28
- Assignees: Canon Kabushiki Kaisha
- Inventors: Mitsuhiro Saito; Ken Terasawa
- Web page: https://patentgrep.com/patent/US20120249844A1

## CPC

- H04N 23/741: by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing apparatus such as a digital camera and a method of controlling the same is provided. In one embodiment, the digital camera generates an HDR image by combining two of a plurality of images to be combined for normal HDR processing. Before image combining operation, the digital camera converts the tone characteristics of at least one of the two images so as to assign more tone values to a tone area of an entire tone area of the HDR image which is not properly covered by either of the two images than before conversion.

## Claims

### Claim 1

An image processing apparatus including a generation unit which is capable of generating a high dynamic range (HDR) image by combining N (N is an integer not less than three) images captured by a capturing unit with N different exposure values, the apparatus comprising:
a capturing control unit configured to cause the capturing unit to capture two images with two different exposure values;
a conversion unit configured to convert a tone characteristic of at least one of the two images; and
a generation control unit configured to cause the generation unit to combine the two images, the tone characteristic of at least one of which has been converted by said conversion unit,
wherein said conversion unit converts a tone characteristic of at least one of the two images, based on the N exposure values and the two exposure values of the two images, such that a tone characteristic of an HDR image generated from the two images is approximated to a tone characteristic of an HDR image generated from the N images.

### Claim 2

An image processing apparatus including a generation unit which is capable of generating a high dynamic range (HDR) image by combining N (N is an integer not less than three) images captured by a capturing unit with N different exposure values, the apparatus comprising:
a capturing control unit configured to cause the capturing unit to capture two images with two exposure values of the N exposure values;
a conversion unit configured to convert a tone characteristic of at least one of the two images; and
a generation control unit configured to cause the generation unit to combine the two images, the tone characteristic of at least one of which has been converted by said conversion unit,
wherein said conversion unit converts a tone characteristic of at least one of the two images such that:
a tone area, of an entire tone area of an HDR image generated from the N images, which is not covered by either (a) a tone area, of a low-exposure image as one of the two images which exhibits a smaller exposure, whose tone values are not less than a first threshold, or (b) a tone area, of a high-exposure image as one of the two images which exhibits a larger exposure, whose tone values are not more than a second threshold,
is assigned with more tone values than before conversion.

### Claim 3 (depends on 1)

The apparatus according to claim 1, further comprising a selection unit configured to select the two exposure values from the N exposure values.

### Claim 4 (depends on 1)

The apparatus according to claim 1, wherein when the two exposure values are a maximum exposure value and a minimum exposure value of the N exposure values, said conversion unit converts a tone characteristic of a low-exposure image as one of the two images which exhibits a smaller exposure, so as to assign more tone values to a tone area with smaller tone values.

### Claim 5 (depends on 1)

The apparatus according to claim 1, wherein when a difference between the two exposure values is smaller than a difference between a maximum exposure value and a minimum exposure value of the N exposure values, said conversion unit converts a tone characteristic of a low-exposure image as one of the two images which exhibits a smaller exposure so as to assign more tone values to a tone area with larger tone values, and converts a tone characteristic of a high-exposure image as one of the two images which exhibits a larger exposure so as to assign more tone values to a tone area with smaller tone values.

### Claim 6 (depends on 1)

The apparatus according to claim 1, further comprising a designation unit configured to designate, as a target tone area of an entire tone area of an HDR image generated from the two images, one of a tone area near a center of the entire tone area and the other tone area of the entire tone area,
wherein when the tone area near the center is designated, and a difference between the two exposure values is smaller than a difference between a maximum exposure value and a minimum exposure value of the N exposure values, said conversion unit converts a tone characteristic of a low-exposure image as one of the two images which exhibits a smaller exposure so as to assign more tone values to a tone area with larger tone values, and converts a tone characteristic of a high-exposure image as one of the two images which exhibits a larger exposure so as to assign more tone values to a tone area with smaller tone values, and
when the other area is designated, and the two exposure values are a maximum exposure value and a minimum exposure value of the N exposure values, said conversion unit converts a tone characteristic of a low-exposure image as one of the two images which exhibits a smaller exposure so as to assign more tone values to a tone area with smaller tone values.

### Claim 7 (depends on 1)

The apparatus according to claim 1, further comprising a suppression unit configured to suppress noise in an HDR image generated by the generation unit,
wherein said suppression unit suppresses noise more strongly when the generation unit generates an HDR image from the two images than when the generation unit generates an HDR image from the N images.

### Claim 8 (depends on 1)

The apparatus according to claim 1, wherein the two images are captured by said capturing unit before capturing of the N images, combined by the generation unit, and displayed on a display unit.

### Claim 9 (depends on 1)

The apparatus according to claim 1, wherein the two images are two images selected from the N images when the N images are captured, and are combined by the generation unit before the N images are combined by the generation unit.

### Claim 10

A method of controlling an image processing apparatus including a generation unit which is capable of generating a high dynamic range (HDR) image by combining N (N is an integer not less than three) images captured by a capturing unit with N different exposure values, the method comprising:
a capturing control step of causing the capturing unit to capture two images with two different exposure values;
a conversion step of converting a tone characteristic of at least one of the two images; and
a generation control step of causing the generation unit to combine the two images, the tone characteristic of at least one of which has been converted in the conversion step,
wherein in the conversion step, a tone characteristic of at least one of the two images is converted, based on the N exposure values and the two exposure values of the two images, such that a tone characteristic of an HDR image generated from the two images is approximated to a tone characteristic of an HDR image generated from the N images.

### Claim 11

A method of controlling an image processing apparatus including a generation unit which is capable of generating a high dynamic range (HDR) image by combining N (N is an integer not less than three) images captured by a capturing unit with N different exposure values, the method comprising:
a capturing control step of causing the capturing unit to capture two images with two exposure values of the N exposure values;
a conversion step of converting a tone characteristic of at least one of the two images; and
a generation control step of causing the generation unit to combine the two images, the tone characteristic of at least one of which has been converted in the conversion step,
wherein in the conversion step, a tone characteristic of at least one of the two images is converted such that:
a tone area, of an entire tone area of an HDR image generated from the N images, which is not covered by either (a) a tone area, of a low-exposure image as one of the two images which exhibits a smaller exposure, whose tone values are not less than a first threshold, or (b) a tone area, of a high-exposure image as one of the two images which exhibits a larger exposure, whose tone values are not more than a second threshold,
is assigned with more tone values than before conversion.

### Claim 12 (depends on 10)

A non-transitory computer-readable storage medium storing a program for causing a computer to execute the method according to claim 10.

### Claim 13 (depends on 11)

A non-transitory computer-readable storage medium storing a program for causing a computer to execute the method according to claim 11.
