# US 2004/0001639 A1 · Image combination device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0001639 A1
- Document ID: US20040001639A1
- Status: Published application
- Kind: A1
- Application number: 10/412,875
- Filed: 2003-04-14
- Published: 2004-01-01
- Earliest claimed: 2002-04-23
- Assignees: Olympus Optical Co., Ltd.
- Inventors: Yoshinori Ohno
- Web page: https://patentgrep.com/patent/US20040001639A1

## CPC

- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/40: using histogram techniques
- G06T 5/90: Dynamic range modification of images or parts thereof
- G06T 2207/10144: Varying exposure
- G06T 2207/20212: Image combination
- G06T 2207/20221: Image fusion; Image merging
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image combination device which obtains a wide dynamic range image through combination of at least two images with different light exposure, including a photographing means for photographing an appropriate light exposure image and a different light exposure light image from the appropriate light exposure image, a dividing means for dividing a lower frequency region from the appropriate light exposure image on a frequency information of the appropriate light exposure image, a statistic means for calculating a statistics value relating to characteristic values of pixel signals in the lower frequency region, a determining means for determining a pixel signal level to divide pixel signals of the appropriate light exposure image into an appropriate region and a bright or dark region on the static tics value, and a combining means for correcting the appropriate light exposure image and the different light exposure image in tone commensurate with a light exposure ratio thereof and combining the appropriate light exposure image and the different light exposure image on the pixel signal level.

## Claims

### Claim 1

An image combination device which obtains a wide dynamic range image through combination of at least two images with different light exposure, comprising:
a photographing means for photographing an appropriate light exposure image and a different light exposure light image from the appropriate light exposure image,
a dividing means for dividing a lower frequency region from the appropriate light exposure image on a frequency information of the appropriate light exposure image,
a statistic means for calculating a statistics value relating to characteristic values of pixel signals in the lower frequency region,
a determining means for determining a pixel signal level to divide pixel signals of the appropriate light exposure image into an appropriate region and a bright or dark region on the static tics value, and
a combining means for correcting the appropriate light exposure image and the different light exposure image in tone commensurate with a light exposure ratio thereof and combining the appropriate light exposure image and the different light exposure image on the pixel signal level.

### Claim 2 (depends on 1)

The image combination device as defined in claim 1, wherein the dividing means, the statistic means and the determining means constitute a threshold value calculating means.

### Claim 3 (depends on 1)

The image combination device as defined in claim 1, wherein the dividing means comprises:
a pixel signal calculating means for calculating the pixel signals of the appropriate light exposure image,
an edge extracting means for calculating edge intensities on the pixel signals of the appropriate light exposure image, and
a region extracting means for extracting edge non-existence regions on comparison with the edge intensities and a predetermined value.

### Claim 4 (depends on 3)

The image combination device as defined in claim 3, wherein in the pixel signal calculating means, a brightness of each pixel of the appropriate light exposure image is calculated.

### Claim 5 (depends on 4)

The image combination device as defined in claim 4, wherein the brightness of each pixel of the appropriate light exposure image is calculated on the equation of Y=0.299×R+0.587×G+0.114×B (Y:brightness, R: red signal brightness, G: green signal brightness, B: blue signal brightness).

### Claim 6 (depends on 3)

The image combination device as defined in claim 3, wherein the edge extracting means includes at least one of a Prewitt filter and a Sobel filter.

### Claim 7 (depends on 3)

The image combination device as defined in claim 3, wherein in the region extracting means, different identifiers are defined for pixels of the appropriate light exposure image on comparison with the edge intensities and the predetermined value.

### Claim 8 (depends on 1)

The image combination device as defined in claim 1, wherein the statistic means comprises:
a pixel extracting means for reading out the pixel signals in the lower frequency region of the appropriate light exposure image,
an adding means for calculating a histogram of the pixel signals of the appropriate light exposure image, and
a smoothing means for averaging the adjacent signal levels of the histogram.

### Claim 9 (depends on 8)

The image combination device as defined in claim 8, wherein the determining means comprises:
an extremal value detecting means for differentiating the histogram and thus, detecting maximum values and minimum values of the resultant differentiated data,
a difference detecting means for detecting differences between the minimum values and the maximum values in the vicinity of their respective minimum values and
a comparing means for determining a maximum difference value from the differences between the minimum values and the maximum values.

### Claim 10 (depends on 1)

The image combination device as defined in claim 1, further comprising a compensating means for compensating data of the appropriate light exposure image.

### Claim 11 (depends on 10)

The image combination device as defined in claim 10, further comprising an input-output controlling means for controlling introduction of the resultant compensated date of the appropriate light exposure image into the dividing means and the statistic means.

### Claim 12

An image combination device which obtains a wide dynamic range image through combination of at least two images with different light exposure, comprising:
a photographing means for photographing an appropriate light exposure image and a different light exposure light image from the appropriate light exposure image,
a dividing means for dividing a lower frequency region from the appropriate light exposure image on a frequency information of the appropriate light exposure image,
a limiting means for determining a pixel signal level range which is composed of lower or higher pixel signals in brightness than a predetermined value within a range of the different light exposure image corresponding to the lower frequency region of the appropriate light exposure image, and
a combining means for correcting the appropriate light exposure image and the different light exposure image in tone commensurate with a light exposure ratio thereof and combining the appropriate light exposure image and the different light exposure image on the pixel signal level.

### Claim 13 (depends on 12)

The image combination device as defined in claim 12, wherein the dividing means and the limiting means constitutes a range calculating means.

### Claim 14 (depends on 12)

The image combination device as defined in claim 12, wherein the dividing means comprises:
a pixel signal calculating means for calculating the pixel signals of the appropriate light exposure image,
an edge extracting means for calculating edge intensities on the pixel signals of the appropriate light exposure image, and
a region extracting means for extracting edge non-existence regions on comparison with the edge intensities and a predetermined value.

### Claim 15 (depends on 14)

The image combination device as defined in claim 14, wherein in the pixel signal calculating means, a brightness of each pixel of the appropriate light exposure image is calculated.

### Claim 16 (depends on 15)

The image combination device as defined in claim 15, wherein the brightness of each pixel of the appropriate light exposure image is calculated on the equation of Y=0.299×R+0.587×G+0.114×B (Y:brightness, R: red signal brightness, G: green signal brightness, B: blue signal brightness).

### Claim 17 (depends on 14)

The image combination device as defined in claim 14, wherein the edge extracting means includes at least one of a Prewitt filter and a Sobel filter.

### Claim 18 (depends on 14)

The image combination device as defined in claim 14, wherein in the region extracting means, different identifiers are defined for pixels of the appropriate light exposure image on comparison with the edge intensities and the predetermined value.

### Claim 19 (depends on 12)

The image combination device as defined in claim 12, wherein the limiting means comprises:
a setting means to setting a pixel signal level to divide the lower frequency region of the appropriate light exposure image,
an adding means for selecting pixels lower or higher in brightness than a predetermined value within a range of the different light exposure image corresponding to the divided region of the appropriate light exposure image and adding the number of the selected pixels, and
a judging means for judging whether the added pixel number is within an acceptable range or not.

### Claim 20 (depends on 19)

The image combination device as defined in claim 19, wherein in the limiting means, the pixel signal level is varied so that the added pixel number is set within the acceptable range.

### Claim 21 (depends on 12)

The image combination device as defined in claim 12, further comprising a compensating means for compensating data of the appropriate light exposure image.

### Claim 22 (depends on 21)

The image combination device as defined in claim 21, further comprising an input-output controlling means for controlling introduction of the resultant compensated date of the appropriate light exposure image into the dividing means and the statistic means.

### Claim 23

An image combination device which obtains a wide dynamic range image through combination of at least two images with different light exposure, comprising:
a photographing means for photographing an appropriate light exposure image and a different light exposure light image from the appropriate light exposure image,
a dividing means for dividing a lower frequency region from the appropriate light exposure image on a frequency information of the appropriate light exposure image,
a limiting means for determining a pixel signal level range which is composed of lower or higher pixel signals in brightness than a predetermined value within a range of the different light exposure image corresponding to the lower frequency region of the appropriate light exposure image,
a statistic means for calculating a statistics value relating to characteristic values of pixel signals in the lower frequency region,
a determining means for determining a pixel signal level to divide pixel signals of the appropriate light exposure image into an appropriate region and a bright or dark region on the static tics value, and
a combining means for correcting the appropriate light exposure image and the different light exposure image in tone commensurate with a light exposure ratio thereof and combining the appropriate light exposure image and the different light exposure image on the pixel signal level.

### Claim 24 (depends on 23)

The image combination device as defined in claim 23, wherein the dividing means, the statistic means, the determining means and the limiting means constitute a threshold value calculating means.

### Claim 25 (depends on 23)

The image combination device as defined in claim 23, wherein the dividing means comprises:
a pixel signal calculating means for calculating the pixel signals of the appropriate light exposure image,
an edge extracting means for calculating edge intensities on the pixel signals of the appropriate light exposure image, and
a region extracting means for extracting edge non-existence regions on comparison with the edge intensities and a predetermined value.

### Claim 26 (depends on 25)

The image combination device as defined in claim 25, wherein in the pixel signal calculating means, a brightness of each pixel of the appropriate light exposure image is calculated.

### Claim 27 (depends on 26)

The image combination device as defined in claim 26, wherein the brightness of each pixel of the appropriate light exposure image is calculated on the equation of Y=0.299×R+0.587×G+0.114×B (Y:brightness, R: red signal brightness, G: green signal brightness, B: blue signal brightness).

### Claim 28 (depends on 25)

The image combination device as defined in claim 25, wherein the edge extracting means includes at least one of a Prewitt filter and a Sobel filter.

### Claim 29 (depends on 25)

The image combination device as defined in claim 25, wherein in the region extracting means, different identifiers are defined for pixels of the appropriate light exposure image on comparison with the edge intensities and the predetermined value.

### Claim 30 (depends on 23)

The image combination device as defined in claim 23, wherein the statistic means comprises:
a pixel extracting means for reading out the pixel signals in the lower frequency region of the appropriate light exposure image,
an adding means for calculating a histogram of the pixel signals of the appropriate light exposure image, and
a smoothing means for averaging the adjacent signal levels of the histogram.

### Claim 31 (depends on 23)

The image combination device as defined in claim 23, wherein the determining means comprises:
an extremal value detecting means for differentiating the histogram and thus, detecting maximum values and minimum values of the resultant differentiated data,
a difference detecting means for detecting differences between the minimum values and the maximum values in the vicinity of their respective minimum values and
a comparing means for determining a maximum difference value from the differences between the minimum values and the maximum values.

### Claim 32 (depends on 23)

The image combination device as defined in claim 23, wherein the limiting means comprises:
a setting means to setting a pixel signal level to divide the lower frequency region of the appropriate light exposure image,
an adding means for selecting pixels lower or higher in brightness than a predetermined value within a range of the different light exposure image corresponding to the divided region of the appropriate light exposure image and adding the number of the selected pixels, and
a judging means for judging whether the added pixel number is within an acceptable range or not.

### Claim 33 (depends on 32)

The image combination device as defined in claim 32, wherein in the limiting means, the pixel signal level is varied so that the added pixel number is set within the acceptable range.

### Claim 34 (depends on 23)

The image combination device as defined in claim 23, further comprising a compensating means for compensating data of the appropriate light exposure image.

### Claim 35 (depends on 34)

The image combination device as defined in claim 34, further comprising an input-output controlling means for controlling introduction of the resultant compensated date of the appropriate light exposure image into the dividing means and the statistic means.
