# US 2017/0289460 A1 · Controlling signal-to-noise ratio in high dynamic range automatic exposure control imaging

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0289460 A1
- Document ID: US20170289460A1
- Status: Published application
- Kind: A1
- Application number: 15/087,018
- Filed: 2016-03-31
- Published: 2017-10-05
- Earliest claimed: 2016-03-31
- Assignees: STMicroelectronics (Research & Development) Limited
- Applicants: Stmicroelectronics (Research & Development) Limited
- Inventors: Ed HAWKINS
- Web page: https://patentgrep.com/patent/US20170289460A1

## CPC

- H04N 23/741: by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
- H04N 23/73: by influencing the exposure time
- H04N 23/743: Bracketing, i.e. taking a series of images with varying exposure conditions
- H04N 23/76: by influencing the image signals
- H04N 25/57: Control of the dynamic range
- H04N 25/58: involving two or more exposures
- H04N 25/589: with different integration times, e.g. short and long exposures
- H04N 25/60: Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Method and apparatus for controlling signal-to-noise ratio (SNR) in high dynamic range automatic exposure control imaging are disclosed. In the method and apparatus, image data is received and a shadow threshold is determined based on the image data. Further, a respective threshold integration ratio is determined for each merge transition of a plurality of exposures having a respective plurality of exposure times. The threshold integration ratio is determined based on a threshold SNR for the merge transition. In the method and apparatus, an integration ratio for each merge transition is determined based on the shadow threshold and the threshold integration ratios. An output image is generated based on the determined integration ratios for each merge transition.

## Claims

### Claim 1

An apparatus, comprising:
an input, which, in operation, receives image data;
digital image processing circuitry, which, in operation:
determines a shadow threshold based on the image data;
determines, for each merge transition of a plurality of exposures having a respective plurality of exposure times, a respective threshold integration ratio based on a threshold signal-to-noise ratio (SNR) for the merge transition;
determines, based on the shadow threshold and the threshold integration ratios, an integration ratio for each merge transition; and
generates an output image based on the determined integration ratios for each merge transition.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein generating the output image includes merging the plurality of exposures based on the determined integration ratios for the merge transitions.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the digital image processing circuitry adjusts exposure times of a plurality of subsequent exposures based on the integration ratios for the plurality of merge transitions.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein generating the output image includes:
sending, to a sensor, a command to capture the plurality of subsequent exposures having the adjusted exposure times;
receiving, at the input, the plurality of subsequent exposures having the adjusted exposure times; and
generating the output image by merging the plurality of subsequent exposures having the adjusted exposure times.

### Claim 5 (depends on 3)

The apparatus of claim 3, wherein the plurality of exposure times are different from each other.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein determining the integration ratio for the merge transition includes:
identifying a first ratio between a saturation point of a first exposure having a shortest exposure time and the shadow threshold;
dividing the first ratio into respective integration ratios for each merge transition; and
adjusting the integration ratios based on the threshold integration ratios for merge transitions.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the saturation point of the first exposure is a maximum pixel level of the first exposure.

### Claim 8 (depends on 6)

The apparatus of claim 6, wherein dividing the first ratio includes setting a portion of the first ratio as a first integration ratio for a first merge transition between the first exposure and a second exposure of the plurality of exposures and setting a remainder of the first ratio as the second integration ratio for the second exposure.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein determining the threshold integration ratio for each merge transition includes determining the threshold integration ratio based on an SNR model of a sensor used to capture the plurality of exposures.

### Claim 10 (depends on 2)

The apparatus of claim 2, wherein merging the plurality of exposures includes using a first exposure of the plurality of exposures to provide pixels of an upper mid-tone region of a scene, using one or more other exposures of the plurality of exposures to provide pixels of a lower mid-tone region of the scene, and using another exposure of the plurality of exposures to provide pixels of a shadow region of the scene.

### Claim 11

A system, comprising:
a sensor, which, in operation, captures an image of a scene and outputs image data representative of the scene; and
digital image processing circuitry, which, in operation:
receives the image data;
determines a shadow threshold based on the image data;
determines, for each merge transition of a plurality of exposures having a respective plurality of exposure times, a respective threshold integration based on a threshold signal-to-noise ratio (SNR) for the merge transition;
determines, based on the shadow threshold and the threshold integration ratios, an integration ratio for each merge transition; and
generates an output image based on the determined integration ratios for each merge transition.

### Claim 12 (depends on 11)

The system of claim 11, wherein generating the output image includes merging the plurality of exposures based on the determined integration ratios for the merge transitions.

### Claim 13 (depends on 11)

The system of claim 11, wherein the digital image processing circuitry adjusts exposure times of a plurality of subsequent exposures based on the integration ratios for the plurality of merge transitions.

### Claim 14 (depends on 13)

The system of claim 13, wherein generating the output image includes:
sending, to the sensor, a command to capture the plurality of subsequent exposures having the adjusted exposure times;
receiving the plurality of subsequent exposures having the adjusted exposure times; and
generating the output image by merging the plurality of subsequent exposures having the adjusted exposure times.

### Claim 15

A method, comprising:
receiving image data;
determining a shadow threshold based on the image data;
determining, for each merge transition of a plurality of exposures having a respective plurality of exposure times, a respective threshold integration ratio based on a threshold signal-to-noise ratio (SNR) for the merge transition;
determining, based on the shadow threshold and the threshold integration ratios, an integration ratio for each merge transition; and
generating an output image based on the determined integration ratios for each merge transition.

### Claim 16 (depends on 15)

The method of claim 15, wherein generating the output image includes merging the plurality of exposures based on the determined integration ratios.

### Claim 17 (depends on 15)

The method of claim 15, further comprising:
adjusting exposure times of a plurality of subsequent exposures based on the integration ratios for the plurality of merge transitions.

### Claim 18 (depends on 17)

The method of claim 17, wherein generating the output image includes:
sending, to a sensor, a command to capture the plurality of subsequent exposures having the adjusted exposure times;
receiving the plurality of subsequent exposures having the adjusted exposure times; and
generating the output image by merging the plurality of subsequent exposures having the adjusted exposure times.

### Claim 19

An apparatus, comprising:
means for receiving image data;
means for processing the received image data including:
determining a shadow threshold based on the image data;
determining, for each merge transition of a plurality of exposures having a respective plurality of exposure times, a respective threshold integration ratio based on a threshold signal-to-noise ratio (SNR) for the merge transition;
determining, based on the shadow threshold and the threshold integration ratios, an integration ratio for each merge transition; and
generating an output image based on the determined integration ratios for each merge transition.

### Claim 20 (depends on 19)

The apparatus of claim 19, comprising an integrated circuit, the integrated circuit including one or more of: the means for receiving image data and the means for processing the received image data.

### Claim 21 (depends on 19)

The apparatus of claim 19, wherein the means for processing the received image data includes means for adjusting exposure times of a plurality of subsequent exposures based on the integration ratios for the plurality of merge transitions.

### Claim 22 (depends on 21)

The apparatus of claim 21, wherein the means for processing the received image data, in operation:
sends, to a sensor, a command to capture the plurality of subsequent exposures having the adjusted exposure times;
receives the plurality of subsequent exposures having the adjusted exposure times; and
generates the output image by merging the plurality of subsequent exposures having the adjusted exposure times.
