# US 2019/0378468 A1 · Image processing apparatus, control method thereof, and non-transitory computer-readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378468 A1
- Document ID: US20190378468A1
- Status: Published application
- Kind: A1
- Application number: 16/548,039
- Filed: 2019-08-22
- Published: 2019-12-12
- Earliest claimed: 2017-03-02
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Takayuki Jinno
- Web page: https://patentgrep.com/patent/US20190378468A1

## CPC

- G09G 3/3413: {Details of control of colour illumination sources}
- G09G 5/003: {Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto (specific for a CRT G09G1/165; for a flat panel G09G3/2092)}
- G06T 7/90: Determination of colour characteristics
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G09G 5/10: Intensity circuits
- G09G 5/36: characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- H04N 1/407: Control or modification of tonal gradation or of extreme levels, e.g. background level
- G06T 2207/10024: Color image
- G09G 2320/0613: The adjustment depending on the type of the information to be displayed
- G09G 2320/0673: for control of gamma adjustment, e.g. selecting another gamma curve
- G09G 2320/08: Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal
- G09G 2360/144: the light being ambient light
- G09G 2360/16: Calculation or use of calculated indices related to luminance levels in display data
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

This invention corrects, with consideration to the luminance of a display device, an image artifact related to the luminance or a color that originates from a high-luminance region set as the display target. To achieve this, the invention comprises an obtainment unit which obtains information corresponding to a luminance range which can be displayed by the display device, a derivation unit which derives a correction amount for correcting an artifact of display-target image data based on a maximum luminance value indicated by the obtained information, and a correction unit which corrects the image data based on the derived correction amount and generates display image data.

## Claims

### Claim 1

An image processing apparatus that corrects image data to be displayed on a display device, the apparatus comprising:
an obtainment unit configured to obtain information corresponding to a luminance range which can be displayed by the display device;
a derivation unit configured to derive a correction amount for correcting an artifact of display-target image data based on a maximum luminance value indicated by the information obtained by the obtainment unit; and
a correction unit configured to correct the image data based on the derived correction amount and to generate display image data.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein the correction unit includes
a binarization unit configured to binarize the display-target image data by using a preset luminance threshold, and to generate a binary image in which a high-luminance region and a non-high-luminance region are discriminated,
a calculation unit configured to calculate an average luminance value of the high-luminance region, and
a generation unit configured to generate a first image in which a pixel of the high-luminance region has the average luminance value and a luminance value of a pixel of the non-high-luminance region is assumed to be zero, to generate a second image in which a luminance value is reduced as the pixel falls outside the high-luminance region by executing preset blurring filter processing on the first image, to generate third image data by subtracting the luminance value of the second image from the first image, and to generate image data for performing correction related to an artifact component by correcting the third image based on the correction amount derived by the derivation unit,
wherein the display image data is generated by subtracting the image data generated by the generation unit from the display-target image data.

### Claim 3 (depends on 1)

The apparatus according to claim 1, wherein the correction unit includes
a binarization unit configured to binarize the display-target image data by using a preset luminance threshold to generate a binary image in which a high-luminance region and a non-high-luminance region are discriminated,
a calculation unit configured to calculate an average luminance value of the high-luminance region, and
a generation unit configured to generate a first image in which a pixel of the high-luminance region has the average luminance value and a luminance value of a pixel of the non-high-luminance region is assumed to be zero, to generate a plurality of second images in each of which a luminance value is reduced as the pixel falls outside the high-luminance region by executing blurring filter processing operations having different characteristics from each other on the first image, to select one of the plurality of the second images based on the correction amount derived by the derivation unit, and to generate image data for performing correction related to an artifact component by subtracting the luminance value of the selected second image from the first image,
wherein the display image data is generated by subtracting the image data generated by the generation unit from the display-target image data.

### Claim 4 (depends on 1)

The apparatus according to claim 1, wherein the correction unit includes
a plurality of conversion units which are preset and have different gamma characteristics from each other, and
a selection unit configured to select one of the plurality of conversion unit based on the correction amount derived by the derivation unit,
wherein the display image data is generated by converting the display-target image data by using the selected conversion unit.

### Claim 5 (depends on 4)

The apparatus according to claim 4, wherein, in a coordinate space in which an abscissa indicates an input pixel value and an ordinate indicates an output pixel value, each of the plurality of conversion units has a conversion characteristic passing below a boundary where the input pixel value and the output pixel value are equal to each other.

### Claim 6 (depends on 4)

The apparatus according to claim 4, wherein, in a coordinate space in which an abscissa indicates an input pixel value and an ordinate indicates an output pixel value, each of the plurality of conversion units has a conversion characteristic passing above a boundary where the input pixel value and the output pixel value are equal to each other.

### Claim 7 (depends on 1)

The apparatus according to claim 1, wherein the correction unit includes
a binarization unit configured to binarize the display-target image data by using a preset luminance threshold to generate a binary image in which a high-luminance region and a non-high-luminance region are discriminated,
a calculation unit configured to calculate an average luminance value of the high-luminance region,
a first generation unit configured to generate a first image in which a pixel of the high-luminance region has the average luminance value and a luminance value of a pixel of the non-high-luminance region is assumed to be zero, to generate a second image in which a luminance value is reduced as the pixel falls outside the high-luminance region by executing preset blurring filter processing on the first image, to generate third image data by subtracting the luminance value of the second image from the first image, and to correct the third image based on the correction amount derived by the derivation unit to generate fourth image data for removing an artifact, and
a second generation unit configured to generate, with respect to the third image, image data for correction that expresses an artifact component based on the correction amount derived by the derivation unit,
wherein the display image data is generated by adding the image data generated by the second generation unit to the image data obtained by subtracting the fourth image data from the display-target image data.

### Claim 8 (depends on 7)

The apparatus according to claim 7, wherein the second generation unit generates one of image data in which a luminance value to be added is increased the farther a distance is from the high-luminance region and image data in which the luminance value to be added increases the closer the distance is from the high-luminance region.

### Claim 9 (depends on 1)

The apparatus according to claim 1, further comprising:
a display control unit configured to display on the display device an image indicated by the display image data obtained by the correction unit and a user interface which adjusts the correction amount in accordance with an operation by a user.

### Claim 10 (depends on 1)

The apparatus according to claim 1, wherein the obtainment unit further obtains information related to environmental light intensity of the surroundings of the display device, and
the derivation unit derives the correction amount based on the environmental light intensity and the maximum luminance value of the display device.

### Claim 11

A control method of an image processing apparatus that corrects image data to be displayed on a display device, the method comprising:
obtaining information corresponding to a luminance range that can be displayed by the display device;
deriving a correction amount for correcting an artifact of display-target image data based on a maximum luminance value indicated by the information obtained in the obtaining; and
correcting the image data based on the derived correction amount and generate display image data.

### Claim 12 (depends on 11)

The method according to claim 11, characterized in that
the correcting includes
(a) binarizing the display-target image data by using a preset luminance threshold and generating a binary image in which a high-luminance region and a non-high-luminance region are discriminated,
(b) calculating an average luminance value of the high-luminance region, and
(c) generating a first image in which a pixel of the high-luminance region has the average luminance value and a luminance value of a pixel of the non-high-luminance region is assumed to be zero, generating a second image in which a luminance value is reduced as the pixel falls outside the high-luminance region by executing preset blurring filter processing on the first image, generating third image data by subtracting the luminance value of the second image from the first image, and generating image data for performing correction related to an artifact component by correcting the third image based on the correction amount derived in the derivation.
wherein the display image data is generated by subtracting the image data generated in the generating (c) from the display-target image data.

### Claim 13 (depends on 11)

The method according to claim 11, wherein the correcting includes
(a) binarizing the display-target image data by using a preset luminance threshold, and generating a binary image in which a high-luminance region and a non-high-luminance region are discriminated,
(b) calculating an average luminance value of the high-luminance region, and
(c) generating a first image in which a pixel of the high-luminance region has the average luminance value and a luminance value of a pixel of the non-high-luminance region is assumed to be zero, generating a plurality of second images in each of which a luminance value is reduced as the pixel falls outside the high-luminance region by executing blurring filter processing operations having different characteristics from each other on the first image, selecting one of the plurality of the second images based on the correction amount derived by the deriving, and generating image data for performing correction related to an artifact component by subtracting the luminance value of the selected second image from the first image,
wherein the display image data is generated by subtracting the image data generated in the generating (c) from the display-target image data.

### Claim 14 (depends on 11)

The method according to claim 11, wherein the correcting includes
a plurality of conversion steps which are preset and use different gamma characteristics from each other, and
selecting one of the plurality of conversion steps based on the correction amount derived in the deriving,
wherein the display image data is generated by converting the display-target image data by using the selected conversion step.

### Claim 15 (depends on 14)

The method according to claim 14, wherein, in a coordinate space in which an abscissa indicates an input pixel value and an ordinate indicates an output pixel value, each of the plurality of conversion steps has a conversion characteristic passing below a boundary where the input pixel value and the output pixel value are equal to each other.

### Claim 16 (depends on 14)

The method according to claim 14, wherein, in a coordinate space in which an abscissa indicates an input pixel value and an ordinate indicates an output pixel value, each of the plurality of conversion steps has a conversion characteristic passing above a boundary where the input pixel value and the output pixel value are equal to each other.

### Claim 17 (depends on 11)

The method according to claim 11, wherein the correcting includes
(a) binarizing the display-target image data by using a preset luminance threshold to generate a binary image in which a high-luminance region and a non-high-luminance region are discriminated,
(b) calculating an average luminance value of the high-luminance region,
(c) generating a first image in which a pixel of the high-luminance region has the average luminance value and a luminance value of a pixel of the non-high-luminance region is assumed to be zero, generating a second image in which a luminance value is reduced as the pixel falls outside the high-luminance region by executing preset blurring filter processing on the first image, generating third image data by subtracting the luminance value of the second image from the first image, and correcting the third image based on the correction amount derived by the deriving to generate fourth image data for removing an artifact, and
(d) generating, with respect to the third image, image data for correction that expresses an artifact component based on the correction amount derived in the deriving,
wherein the display image data is generated by adding the image data generated in the generating (d) to the image data obtained by subtracting the fourth image data from the display-target image data.

### Claim 18 (depends on 17)

The method according to claim 17, wherein, in the generating (d), one of image data in which a luminance value to be added is increased the farther a distance is from the high-luminance region and image data in which the luminance value to be added is increased the closer the distance is from the high-luminance region is generated.

### Claim 19 (depends on 11)

The method according to claim 11, further comprising:
displaying, on the display device, an image indicated by the display image data obtained in the correcting and a user interface which adjusts the correction amount in accordance with an operation by a user.

### Claim 20

A non-transitory computer-readable storage medium storing a program which, when read and executed by a computer, causes the computer to execute the steps of a control method of an image processing apparatus that corrects image data to be displayed on a display device, the method comprising:
obtaining information corresponding to a luminance range that can be displayed by the display device;
deriving a correction amount for correcting an artifact of display-target image data based on a maximum luminance value indicated by the information obtained in the obtaining; and
correcting the image data based on the derived correction amount and generate display image data.
