US 2017/0324913 A1 · IMAGE SENSOR COMBINING HIGH DYNAMIC RANGE TECHNIQUES

Abstract

Various technologies described herein pertain to combining high dynamic range techniques to enable rendering higher dynamic range scenes with an image sensor. The image sensor can implement a combination of spatial exposure multiplexing and temporal exposure multiplexing, for example. By way of another example, the image sensor can implement a combination of spatial exposure multiplexing and dual gain operation. Pursuant to another example, the image sensor can implement a combination of temporal exposure multiplexing and dual gain operation. In accordance with yet another example, the image sensor can implement a combination of spatial exposure multiplexing, temporal exposure multiplexing, and dual gain operation.

Claims16

Dependent claims

(canceled)

An image sensor, comprising:

a pixel array that comprises pixels.
a timing controller configured to control exposure times of the pixels in the pixel array. the timing controller configured to:
control a first subset of the pixels in the pixel array to have a first exposure time during a first time period, wherein a first frame of an input image stream is captured during the first time period;
control a second subset of the pixels in the pixel array to have a second exposure time during the first time period.
control the first subset of the pixels in the pixel array to have a third exposure time during a second time period, wherein a second frame of the input image stream is captured during the second time period;
and
control the second subset of the pixels in the pixel array to have a fourth exposure time during the second time period;
wherein the first exposure time, the second exposure time, the third exposure time, and the fourth exposure time differ from each other;
readout circuit configured to read out signals from the pixels in the pixel array for the first frame and the second frame of the input image stream.;
and
an analog-to-digital converter configured to convert the signals to pixel values for the first frame and the second frame of the input image stream;
wherein the first subset of the pixels in the pixel array comprise first non-rectangular units of pixels;
wherein the second subset of the pixels in the pixel array comprise second non-rectangular units of pixels;
wherein the first non-rectangular units of pixels oppose the second non-rectangular units of pixels to form a zigzag pattern in the pixel array;
and
wherein each of the first non-rectangular units of pixels and each of the second non-rectangular units of pixels are L-shaped and comprise three adjacent pixels in a row of the pixel array and a fourth pixel in an adjacent row of the pixel array.

13 more elements

An image sensor, comprising:

a pixel array that comprises pixels, wherein the pixel array comprises a first subset of the pixels and a second subset of the pixels, wherein the first subset of the pixels in the pixel array comprise first non-rectangular units of pixels, wherein the second subset of the pixels in the pixel array comprise second non-rectangular units of pixels, wherein the first non-rectangular units of pixels oppose the second non-rectangular units of pixels to form a zigzag pattern in the pixel array, and wherein each of the first non-rectangular units of pixels and each of the second non-rectangular units of pixels are L-shaped and comprise three adjacent pixels in a row of the pixel array and a fourth pixel in an adjacent row of the pixel array;
a timing controller configured to control exposure times of the pixels in the pixel array, the timing controller configured to control the exposure times of the pixels at least one of temporally or spatially such that an input image stream has two or more differing exposure times;
a readout circuit configured to:
read out signals from the pixels in the pixel array for the input image stream having the two or more differing exposure times;
amplify the signals read out from the pixels in the pixel array by a first analog gain to output first amplified signals for the input image stream having the two or more differing exposure times;
and
amplify the signals read out from the pixels in the pixel array by a second analog gain to output second amplified signals for the input image stream having the two or more differing exposure times, wherein the first analog gain differs from the second analog gain;
and
an analog-to-digital converter configured to:
convert the first amplified signals to first amplified pixel values for the input image stream having the two or more differing exposure times;
and
convert the second amplified signals to second amplified pixel values for the input image stream having the two or more differing exposure times.

9 more elements

A method of increasing dynamic range of an image sensor, the image sensor comprising a pixel array that comprises pixels, the method comprising:

controlling a first subset of the pixels in the pixel array to have a first exposure time during a first time period, wherein a first frame of an input image stream is captured during the first time period;
controlling a second subset of the pixels in the pixel array to have a second exposure time during the first time period;
reading out signals from the pixels in the pixel array for the first frame of the input image stream;
converting the signals for the first frame to digital pixel values for the first frame of the input image stream;
controlling the first subset of the pixels in the pixel array to have a third exposure time during a second time period, wherein a second frame of the input image stream is captured during the second time period;
controlling the second subset of the pixels in the pixel array to have a fourth exposure time during the second time period, wherein the first exposure time, the second exposure time, the third exposure time, and the fourth exposure time differ from each other;
reading out signals from the pixels in the pixel array for the second frame of the input image stream;
and
converting the signals for the second frame to digital pixel values for the second frame of the input image stream;
wherein the first subset of the pixels in the pixel array comprise first non-rectangular units of pixels;
wherein the second subset of the pixels in the pixel array comprise second non-rectangular units of pixels;
wherein the first non-rectangular units of pixels oppose the second non-rectangular units of pixels to form a zigzag pattern in the pixel array;
and
wherein each of the first non-rectangular units of pixels and each of the second non-rectangular units of pixels are L-shaped and comprise three adjacent pixels in a row of the pixel array and a fourth pixel in an adjacent row of the pixel array.

11 more elements

Dependencies are inferred from the claim text.

Image sensor combining high dynamic range techniques

Life of this patent

Image sensor combining high dynamic range techniques

Life of this patent

Abstract

Claims16