# US 2020/0288051 A1 · Image processing apparatus, image processing method, and non-transitory computer-readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0288051 A1
- Document ID: US20200288051A1
- Status: Published application
- Kind: A1
- Application number: 16/808,623
- Filed: 2020-03-04
- Published: 2020-09-10
- Earliest claimed: 2019-03-05
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Tetsuya Suwa
- Web page: https://patentgrep.com/patent/US20200288051A1

## CPC

- G06T 5/90: Dynamic range modification of images or parts thereof
- G06V 10/20: Image preprocessing
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 23/741: by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
- H04N 25/13: characterised by the spectral characteristics of the filter elements
- G06F 2218/12: Classification; Matching
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An image processing apparatus comprises a classification unit which classifies, based on a correspondence relationship of luminance value conversion from a first luminance range to a second luminance range smaller than the first luminance range, the first luminance range of the image data into a plurality of regions; and a display unit which causes a display device to display an image based on the image data such that a pixel of the image which has a luminance value belonging to a region, in which a tone characteristic in the image data can be restored if the luminance value of the image data is converted to a luminance value corresponding to the second luminance range, can be specified.

## Claims

### Claim 1

An image processing apparatus, comprising:
a first obtainment unit configured to obtain a luminance value of image data corresponding to a first luminance range;
a second obtainment unit configured to obtain information for a second luminance range which is smaller than the first luminance range;
a classification unit configured to classify, based on a correspondence relationship of luminance value conversion from the first luminance range to the second luminance range, the first luminance range of the image data into a plurality of regions; and
a display unit configured to cause a display device to display an image based on the image data such that a pixel of the image which has a luminance value belonging to a region, in which a tone characteristic in the image data can be restored in a case where the luminance value of the image data is converted to a luminance value corresponding to the second luminance range, can be specified in the displayed image.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein in a case where the luminance value of the image data is converted to a luminance value corresponding to the second luminance range, the classification unit further classifies the first luminance range into a saturated luminance value region in which the luminance value of the image data is converted to a maximum value in the second luminance range and an unsaturated luminance value region.

### Claim 3 (depends on 2)

The apparatus according to claim 2, wherein the classification unit classifies the saturated luminance value region by using, as a reference, a luminance value in which at least one of R (red), G (green), and B (blue) values of a pixel of the image data has become saturated.

### Claim 4 (depends on 1)

The apparatus according to claim 1, wherein, the classification unit further classifies the first luminance range into a region in which the tone characteristic has degraded and a region in which the tone characteristic has not degraded in a case where the luminance value of the image data is converted to the luminance value corresponding to the second luminance range.

### Claim 5 (depends on 4)

The apparatus according to claim 4, wherein the classification unit classifies the region in which the tone characteristic has degraded by using, as a reference, a luminance value in which an input value and an output value will match in the correspondence relationship of the luminance value conversion from the first luminance range to the second luminance range.

### Claim 6 (depends on 1)

The apparatus according to claim 1, wherein the classification unit classifies, based on image capturing information of an image capturing apparatus which have captured a target for obtaining the image data, a region in which the tone characteristic can be restored.

### Claim 7 (depends on 6)

The apparatus according to claim 6, wherein the image capturing information includes information of a characteristic of a sensor used in a photoelectric conversion unit included in the image capturing apparatus.

### Claim 8 (depends on 1)

The apparatus according to claim 1, wherein the display unit causes the display device to display the plurality of regions by different display modes.

### Claim 9 (depends on 1)

The apparatus according to claim 1, wherein restoration of the tone characteristic is performed by converting the luminance value of a low-frequency component of a pixel of an image indicated by the image data to the luminance value corresponding to the second luminance range and superimposing a high-frequency component of the image data on the obtained luminance value of the low-frequency component by the conversion.

### Claim 10 (depends on 9)

The apparatus according to claim 9, wherein the low-frequency component and the high-frequency component are determined based on information of a viewing environment when the image data is output.

### Claim 11 (depends on 1)

The apparatus according to claim 1, wherein the image data is RAW data photoelectrically converted by an image capturing element.

### Claim 12 (depends on 1)

The apparatus according to claim 1, further comprising a conversion unit configured to convert the luminance value of the image data to the luminance value corresponding to the second luminance range.

### Claim 13 (depends on 12)

The apparatus according to claim 12, further comprising a superimposing unit configured to superimpose a high-frequency component of the image data on the luminance value of a low-frequency component obtained by conversion by the conversion unit.

### Claim 14

An image processing method comprising:
obtaining a luminance value of image data corresponding to a first luminance range;
obtaining information for a second luminance range which is smaller than the first luminance range;
classifying, based on a correspondence relationship of luminance value conversion from the first luminance range to the second luminance range, the first luminance range of the image data into a plurality of regions; and
causing a display device to display an image based on the image data such that a pixel of the image which has a luminance value belonging to a region, in which a tone characteristic in the image data can be restored in a case where the luminance value of the image data is converted to a luminance value corresponding to the second luminance range, can be specified in the displayed image.

### Claim 15

A non-transitory computer-readable storage medium storing a program that causes a computer to function as a first obtainment unit configured to obtain a luminance value of image data corresponding to a first luminance range;
a second obtainment unit configured to obtain information for a second luminance range which is smaller than the first luminance range;
a classification unit configured to classify, based on a correspondence relationship of luminance value conversion from the first luminance range to the second luminance range, the first luminance range of the image data into a plurality of regions; and
a display unit configured to cause a display device to display an image based on the image data such that a pixel of the image which has a luminance value belonging to a region, in which a tone characteristic in the image data can be restored in a case where the luminance value of the image data is converted to a luminance value corresponding to the second luminance range, can be specified in the displayed image.
