# US 2021/0243390 A1 · Global shutter image sensor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243390 A1
- Document ID: US20210243390A1
- Status: Published application
- Kind: A1
- Application number: 17/150,925
- Filed: 2021-01-15
- Published: 2021-08-05
- Earliest claimed: 2018-06-28
- Assignees: Facebook Technologies, LLC
- Applicants: Facebook Technologies, LLC
- Inventors: Xinqiao LIU; Song CHEN; Andrew Samuel BERKOVICH
- Web page: https://patentgrep.com/patent/US20210243390A1

## CPC

- G01J 1/44: Electric circuits {(for command of an exposure part G03B7/02)}
- H04N 25/59: by controlling the amount of charge storable in the pixel, e.g. modification of the charge conversion ratio of the floating node capacitance
- H04N 25/532: by controlling global shutters in CMOS SSIS
- H04N 25/616: involving a correlated sampling function, e.g. correlated double sampling [CDS] or triple sampling
- H04N 25/771: comprising storage means other than floating diffusion
- H04N 25/772: comprising A/D, V/T, V/F, I/T or I/F converters
- H04N 25/78: Readout circuits for addressed sensors, e.g. output amplifiers or A/D converters
- G01J 2001/4413: {Type}
- G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In one example, an apparatus is provided. The apparatus includes a photodiode, a charge sensing unit, an analog-to-digital converter (ADC), and a controller. The controller is configured to: enable the photodiode to generate charge in response to incident light, accumulate at least a portion of the charge as residual charge until the photodiode becomes saturated by the residual charge, and transfer the remaining portion of the charge to the charge sensing unit as overflow charge if the photodiode becomes saturated by the residual charge. The controller is further configured to: generate, using the ADC, a first digital output based on the residual charge; after generating the first digital output, generate, using the ADC, a second digital output based on the overflow charge; and generate a digital representation of an intensity of the incident light based on at least one of the first digital output or the second digital output.

## Claims

### Claim 1

An apparatus comprising:
a photodiode;
a charge sensing unit;
an analog-to-digital converter (ADC); and
a controller configured to:
enable the photodiode to:
generate charge in response to incident light;
accumulate at least a portion of the charge as residual charge until the photodiode becomes saturated by the residual charge; and
transfer the remaining portion of the charge to the charge sensing unit as overflow charge if the photodiode becomes saturated by the residual charge;
generate, using the ADC, a first digital output based on the residual charge;
after generating the first digital output, generate, using the ADC, a second digital output based on the overflow charge; and
generate a digital representation of an intensity of the incident light based on at least one of the first digital output or the second digital output.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the photodiode is enabled to generate the charge in response to the incident light within an exposure period; and
wherein the first digital output and the second digital output are generated after the exposure period ends.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the charge sensing unit comprises a first charge storage device and a second charge storage device;
wherein the controller is configured to:
enable the photodiode to transfer the overflow charge to the first charge storage device and the second charge storage device;
disconnect the first charge storage device from the second charge storage device;
enable the photodiode to transfer the residual charge to the first charge storage device to cause the charge sensing unit to generate a first voltage; and
generate, using the ADC, the first digital output based on quantizing the first voltage.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the transfer of the overflow charge to the first charge storage device ends at the same time as the exposure period.

### Claim 5 (depends on 3)

The apparatus of claim 3, wherein the controller is configured to reset the first charge storage device to remove a first portion of the overflow charge stored in the first charge storage device prior to transferring the residual charge to the first charge storage device.

### Claim 6 (depends on 3)

The apparatus of claim 3, wherein the controller is configured to, after generating the first digital output:
connect the first charge storage device with the second charge storage device to cause the charge sensing unit to generate a second voltage;
generate, using the ADC, the second digital output based on quantizing the second voltage.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the controller is configured to generate a third digital output representing a quantity of the residual charge and a fourth digital output representing a quantity of the overflow charge based on the first digital output and the second digital output.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the controller is configured to:
determine whether the photodiode is saturated by the residual charge within the exposure period; and
based on whether the photodiode is saturated by the residual charge within the exposure period, output one of the third digital output or the fourth digital output as the digital representation to represent the intensity of the incident light.

### Claim 9 (depends on 7)

The apparatus of claim 7, wherein the controller is configured to, within the exposure period:
determine whether a quantity of the overflow charge stored in the charge sensing unit exceeds a saturation threshold; and
based on the quantity of the overflow charge stored in the charge sensing unit exceeds the saturation threshold, output a time when the quantity exceeds the saturation threshold as the digital representation to represent the intensity of the incident light.

### Claim 10 (depends on 9)

The apparatus of claim 9, further comprising a memory and a counter;
wherein the ADC comprises a comparator; and
wherein the controller is configured to, after the exposure period, and based on the quantity of the overflow charge stored in the charge sensing unit within the exposure period exceeding the saturation threshold:
compare, using the comparator, the first voltage against a first varying threshold voltage to output a first decision, the first varying threshold voltage increasing or decreasing with respect to a first clock;
obtain the first digital output from the counter based on the first decision;
compare the second voltage against a second varying threshold voltage to output a second decision, the second varying threshold voltage increasing or decreasing with respect to a second clock;
obtain the second digital output from the counter based on the second decision;
store both the first digital output and the second digital output in the memory; and
determine whether the photodiode is saturated by the residual charge within the exposure period based on at least one of the first decision or the second decision.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the first and second varying threshold voltages comprise, respectively, a first ramping voltage and a second ramping voltage.

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein:
the first varying threshold voltage increases with respect to the first clock and the second varying threshold voltage decreases with respect to the second clock; or
the first varying threshold voltage decreases with respect to the first clock and the second varying threshold voltage increases with respect to the second clock.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein a polarity of comparison between the first voltage against the first varying threshold voltage is opposite to a polarity of comparison between the second voltage against the second varying threshold voltage.

### Claim 14 (depends on 10)

The apparatus of claim 10, wherein a range of the first varying threshold voltage is configured based on an average full well capacity of the photodiode and a margin based on dark current.

### Claim 15 (depends on 10)

The apparatus of claim 10, wherein the controller is configured to:
within the exposure period, compare, using the comparator, the first voltage against a static threshold to generate a third decision; and
determine whether the quantity of the overflow charge stored in the charge sensing unit exceeds the saturation threshold based on the third decision.

### Claim 16 (depends on 10)

The apparatus of claim 10, further comprising an AC capacitor coupled between the charge sensing unit and the ADC;
wherein the controller is configured to reset the first charge storage device and the second charge storage device before the exposure period starts, and reset the comparator, prior to transferring the residual charge to the first charge storage device to store a first charge in the AC capacitor representing a first reset noise signal and an offset voltage of the comparator; and
wherein the controller is configured to reset the first charge storage device, the second charge storage device, and the comparator after connecting the first charge storage device with the second charge storage device to store a second charge in the AC capacitor representing a second reset noise signal and an offset voltage of the comparator.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the controller is configured to reset the first charge storage device simultaneously with the comparator prior to transferring the residual charge to the first charge storage device to store the first charge in the AC capacitor.

### Claim 18 (depends on 16)

The apparatus of claim 16, wherein the controller is configured to reset the comparator prior to resetting the first and second charge storage devices after connecting the first charge storage with the second charge storage device to store the second charge in the AC capacitor.

### Claim 19

A method comprising:
enabling a photodiode to:
generate charge in response to incident light;
accumulate at least a portion of the charge as residual charge until the photodiode becomes saturated by the residual charge; and
transfer the remaining portion of the charge to the charge sensing unit as overflow charge if the photodiode becomes saturated by the residual charge;
generating, using an analog-to-digital converter (ADC), a first digital output based on the residual charge;
after generating the first digital output, generate, using the ADC, a second digital output based on measuring the overflow charge; and
generating a digital representation of an intensity of the incident light based on at least one of the first digital output or the second digital output.

### Claim 20 (depends on 19)

The method of claim 19, wherein the photodiode is enabled to generate the charge in response to incident light within the exposure period; and
wherein the first digital output and the second digital output are generated after the exposure period ends.