# US 2020/0007734 A1 · Image processing apparatus, control method, and non-transitory computer-readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0007734 A1
- Document ID: US20200007734A1
- Status: Published application
- Kind: A1
- Application number: 16/446,838
- Filed: 2019-06-20
- Published: 2020-01-02
- Earliest claimed: 2018-06-29
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Hidetsugu Kagawa; Shuhei Ogawa; Tetsuya Suwa; Maya Yazawa
- Web page: https://patentgrep.com/patent/US20200007734A1

## CPC

- H04N 23/741: by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/92: based on global image properties
- G06T 7/11: Region-based segmentation
- G06T 7/174: involving the use of two or more images
- G06T 2207/10024: Color image
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T 2207/20208: High dynamic range [HDR] image processing
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing apparatus divides a first image into a plurality of areas based on obtained image data of the first image and sets relationship information between input brightness values with output brightness values for each of the plurality of areas, and converts, based on the relationship information, a brightness value of pixels included in the first image into a brightness value of pixels of a second image whose brightness range is narrower than that of the first image. In the conversion, the apparatus sets, for at least some pixels of the first image, a size of a window for specifying pixels within a predetermined area including the pixels based on environment information in which the second image is observed, and calculates a brightness value in the second image for each of the at least some pixels based on the window.

## Claims

### Claim 1

An image processing apparatus comprising:
at least one processor; and
at least one memory coupled to the at least one processor, wherein the at least one memory stores an instruction that causes, when executed by the at least one processor, the image processing apparatus to:
divide a first image into a plurality of areas based on obtained image data of the first image having first brightness and set, for each of the plurality of areas, relationship information that associates an input brightness value with an output brightness value; and
convert, based on the relationship information, a brightness value of a pixel included in the first image into a brightness value of a pixel of a second image of which a brightness range is narrower than that of the first image,
wherein the instruction further causes, when executed by the at least one processor, the image processing apparatus to:
in the conversion,
obtain information of an environment when the second image is observed;
set, for at least some pixels of the first image, a size of a window configured to specify pixels within a predetermined area including the pixels, based on the information of the environment; and
calculate a brightness value in the second image for each of the at least some pixels based on the relationship information set for an area, at least part of which is within the window.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein the instruction further causes, when executed by the at least one processor, the image processing apparatus to:
in the calculation,
perform, for each of the at least some pixels, specifying the relationship information for the pixel based on the relationship information set for at least two areas at least part of which are included within the predetermined area in the plurality of areas, and
calculate the brightness value of the pixel in the second image using the specified relationship information.

### Claim 3 (depends on 1)

The apparatus according to claim 1, wherein the instruction further causes, when executed by the at least one processor, the image processing apparatus to:
in the calculation,
specify an average brightness value of the brightness values after conversion using the relationship information set for each of the plurality of areas; and
perform, for each of the at least some pixels, weighted addition of the average brightness values for at least two areas included within the predetermined area in the plurality of areas, thereby calculating the brightness value of the pixel in the second image.

### Claim 4 (depends on 2)

The apparatus according to claim 2, wherein the specifying is performed by performing weighted addition for each of the at least some pixels using a weight determined based on a size of each of the at least two areas included within the predetermined area in the plurality of areas.

### Claim 5 (depends on 2)

The apparatus according to claim 2, wherein the specifying is performed by performing weighted addition for each of the at least some pixels using a weight determined based on a difference between the brightness value of the pixel and an average brightness value of each of the at least two areas included within the predetermined area in the plurality of areas.

### Claim 6 (depends on 1)

The apparatus according to claim 1, wherein the information of the environment includes information on a resolution of the second image.

### Claim 7 (depends on 6)

The apparatus according to claim 6, wherein the information of the environment further includes a brightness of the second image.

### Claim 8 (depends on 1)

The apparatus according to claim 1, wherein the information of the environment includes information on an observation distance when observing the second image.

### Claim 9 (depends on 1)

The apparatus according to claim 1, wherein the information of the environment includes a frequency of the first image.

### Claim 10

A control method of an image processing apparatus, comprising:
dividing a first image into a plurality of areas based on obtained image data of the first image having first brightness and setting, for each of the plurality of areas, relationship information that associates an input brightness value with an output brightness value; and
converting, based on the relationship information, a brightness value of a pixel included in the first image into a brightness value of a pixel of a second image of which a brightness range is narrower than that of the first image,
wherein the converting includes:
obtaining information of an environment in which the second image is observed;
setting, for at least some pixels of the first image, a size of a window configured to specify pixels within a predetermined area including the pixels, based on the information of the environment; and
calculating a brightness value in the second image for each of the at least some pixels based on the relationship information set for an area, at least part of which is within the window.

### Claim 11 (depends on 10)

The method according to claim 10, wherein in the calculating,
the relationship information for the pixel is specified based on the relationship information set for at least two areas at least part of which are included within the predetermined area in the plurality of areas, and
the brightness value of the pixel in the second image is calculated using the specified relationship information.

### Claim 12 (depends on 10)

The method according to claim 10, wherein in the calculating,
an average brightness value of the brightness values after conversion using the relationship information set for each of the plurality of areas is specified; and
weighted addition of the average brightness values for at least two areas included within the predetermined area in the plurality of areas is performed for each of the at least some pixels, thereby calculating the brightness value of the pixel in the second image.

### Claim 13 (depends on 11)

The method according to claim 11, wherein the relationship information for the pixel is specified by performing weighted addition for each of the at least some pixels using a weight determined based on a size of each of the at least two areas included within the predetermined area in the plurality of areas.

### Claim 14 (depends on 11)

The method according to claim 11, wherein the relationship information for the pixel is specified by performing weighted addition for each of the at least some pixels using a weight determined based on a difference between the brightness value of the pixel and an average brightness value of each of the at least two areas included within the predetermined area in the plurality of areas.

### Claim 15 (depends on 10)

The method according to claim 10, wherein the information of the environment includes information on a resolution of the second image.

### Claim 16 (depends on 15)

The method according to claim 15, wherein the information of the environment further includes a brightness of the second image.

### Claim 17 (depends on 10)

The method according to claim 10, wherein the information of the environment includes information on an observation distance when observing the second image

### Claim 18 (depends on 10)

The method according to claim 10, wherein the information of the environment includes a frequency of the first image.

### Claim 19

A non-transitory computer-readable storage medium that stores a computer program configured to cause a computer provided in an image processing apparatus to:
divide a first image into a plurality of areas based on obtained image data of the first image having first brightness and set, for each of the plurality of areas, relationship information that associates an input brightness value with an output brightness value; and
convert, based on the relationship information, a brightness value of a pixel included in the first image into a brightness value of a pixel of a second image of which a brightness range is narrower than that of the first image,
wherein the conversion includes:
obtaining information of an environment in which the second image is observed;
setting, for at least some pixels of the first image, a size of a window configured to specify pixels within a predetermined area including the pixels, based on the information of the environment; and
calculating a brightness value in the second image for each of the at least some pixels based on the relationship information set for an area, at least part of which is within the window.
