# US 2020/0396409 A1 · Event-based image sensor and operating method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0396409 A1
- Document ID: US20200396409A1
- Status: Published application
- Kind: A1
- Application number: 16/771,665
- Filed: 2018-12-11
- Published: 2020-12-17
- Earliest claimed: 2017-12-11
- Assignees: Prophesee
- Applicants: Prophesee
- Inventors: Christoph POSCH; Daniel MATOLIN
- Web page: https://patentgrep.com/patent/US20200396409A1

## CPC

- H04N 25/771: comprising storage means other than floating diffusion
- H04N 25/47: Image sensors with pixel address output; Event-driven image sensors; Selection of pixels to be read out based on image data
- H04N 25/707: Pixels for event detection
- H04N 25/77: Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
- H04N 25/772: comprising A/D, V/T, V/F, I/T or I/F converters
- H04N 25/779: Circuitry for scanning or addressing the pixel array
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An event-based image sensor is provided that includes a plurality of pixel circuits. Each pixel circuit includes a photoreceptor circuit with a light-sensitive element configured for delivering at an output a photoreceptor current, an analog bus, and a bank of current memory cells connected to the analog bus. An output of the photoreceptor circuit is selectively connected to the analog bus. Each current memory cell is adapted to store an electric current flowing in the analog bus and to deliver an electric current stored within the current memory cell. Each pixel circuit may further include a current comparator including a current sign detector connected to the analog bus and configured for comparing a value of a compared electric current resulting from a difference between the photoreceptor current and a previous photoreceptor current stored in a current memory cell. At least one storage cell may also be provided that has a state conditioned by the output of the current sign detector.

## Claims

### Claim at position 1

1-12. (canceled)

### Claim 13

An event-based image sensor comprising a controller, an address-event representation circuitry, and a plurality of pixel circuits forming a pixel array, the controller connected to each pixel circuit to control said pixel circuits, each pixel circuit comprising:
a photoreceptor circuit comprising a light-sensitive element and an output, said photoreceptor circuit being configured to deliver at said output a photoreceptor current derived from a light impinging on the light-sensitive element;
an analog bus selectively connected to a readout unit, the output of the photoreceptor circuit being selectively connected to said analog bus; and
a plurality of current memory cells connected to the analog bus, each current memory cell being adapted to selectively store an electric current flowing in the analog bus and to selectively deliver into said analog bus an electric current stored within said current memory cell;
wherein each pixel circuit further comprises a current comparator configured to detect a change in the photoreceptor current, said current comparator comprising:
a current sign detector connected to the analog bus and configured to determine a sign of a value of an electric current flowing in the analog bus resulting from a compared electric current and a threshold current, said compared electric current resulting from a difference between at least the photoreceptor current and a previous photoreceptor current stored in a current memory cell; and
at least one storage cell connected to an output of the current sign detector and having a state conditioned by the output of said current sign detector, the state of said at least one storage cell being representative of a change between the photoreceptor current and the previous photoreceptor current greater than the threshold current;
wherein said at least one digital storage cell is connected to the address-event representation circuitry so that the address-event representation circuitry monitors the state of the storage cell to determine a change in the light impinging on the light-sensitive element; and
wherein a readout of a pixel circuit through the connection of the analog bus to the readout unit is conditioned by the state of said at least one digital storage cell.

### Claim 14 (depends on 13)

The event-based image sensor of claim 13, wherein the current comparator comprises a first storage cell and a second storage cell, each of the storage cells being connected to the output of the current sign detector and having a state conditioned by the output of said current sign detector, the state of the first storage cell representative of a value of the compared electric current greater than a value of a first threshold current, the state of the second storage cell representative of a value of the compared electric current lower than a value of a second threshold current.

### Claim 15 (depends on 13)

The event-based image sensor of claim 13, wherein the compared electric current is obtained when a current memory cell storing the photoreceptor current is connected to a current memory cell-storing the previous photoreceptor to the analog bus, the compared electric current being stored into a current memory cell, the threshold current being stored in another current memory cell.

### Claim 16 (depends on 1)

The event-based image sensor of claim 1, wherein the address-event representation circuitry is configured to determine, upon detection of a change in a state of a digital storage cell of a pixel circuit, an address of the pixel circuit whose digital storage cell has changed state.

### Claim 17 (depends on 1)

The event-based image sensor of claim 1, wherein the controller is configured to send instructions to the pixel circuits, and wherein execution of at least one instruction by a pixel circuit is conditioned by a state of at least one storage cell.

### Claim 18 (depends on 1)

The event-based image sensor of claim 1, wherein the photoreceptor circuit a pixel circuit is a logarithmic photoreceptor circuit and the photoreceptor current is proportional to a logarithm of the light impinging on the light-sensitive element.

### Claim 19 (depends on 1)

The event-based image sensor of claim 1, further comprising a calibration current source, wherein the photoreceptor circuit of each pixel circuit is configured to deliver at the output of said photoreceptor circuit a calibration current derived from a reference calibration current supplied by the calibration current source during a calibration procedure.

### Claim 20

A method of operating an event-based image sensor, the event-based image sensor comprising a controller, an address-event representation circuitry, and a plurality of pixel circuits forming a pixel array, the controller connected to each pixel circuit to control said pixel circuits, the method comprising:
detecting, with a change detection cycle, a change in light impinging onto a light-sensitive element of a photoreceptor circuit of a pixel circuit, said change detection cycle comprising:
delivering, with the photoreceptor circuit, a photoreceptor current derived from a light exposure of the light-sensitive element—at the output of said photoreceptor circuit;
storing the photoreceptor current in a first current memory cell;
storing a compared electric current, resulting from a difference between the photoreceptor current and a previous photoreceptor current, in a second current memory cell;
comparing, with a current sign detector, a value of the compared electric current with a value of a threshold current, and if the value of the compared electric current is above the value of the threshold current, setting the state of a digital storage cell to a first state;
if the storage cell is in the first state, reading out the photoreceptor current, storing the photoreceptor current in the second current memory cell, and setting the state of the storage cell to a second state.

### Claim 21 (depends on 20)

The method of claim 20, wherein a current comparator of the pixel circuit comprises a first storage cell and a second storage cell, each connected to the output of a current sign detector of the current comparator and having a state conditioned by an output of said current sign detector.

### Claim 22 (depends on 21)

The method of claim 21, wherein the state of the first storage cell is representative of a value of the compared electric current greater than a value of a first threshold current, and the state of the second storage cell is representative of a value of the compared electric current lower than a value of a second threshold current.

### Claim 23 (depends on 22)

The method of claim 22, wherein comparing, with the current sign detector, the value of the compared electric current with the value of the threshold current comprises:
comparing, with the current sign detector, a value of the compared electric current with a value of a first threshold current stored in a fourth current memory cell, and if the value of the compared electric current is above the value of the first threshold current, setting the state of the first storage cell to a first state; and
comparing, with the current sign detector, a value of an opposite of the compared electric current with a value of a second threshold current stored in a fifth current memory cell, and if the value of the opposite of the compared electric current is above the value of the second threshold current, setting the state of the second storage cell to a first state.

### Claim 24 (depends on 20)

The method of claim 20, wherein during a readout procedure of the pixel array, only pixel circuits that have a storage cell in a first state are selected to have their photoreceptor current read.

### Claim 25 (depends on 23)

The method of claim 23, further comprising a calibration procedure executed before the readout of the photoreceptor current being performed if the storage cell is in the first state, said calibration procedure comprising:
connecting a calibration current source instead of a light-sensitive element in a photoreceptor circuit of a pixel circuit so that the photoreceptor circuit of the pixel circuit delivers at the output of said photoreceptor circuit a calibration current derived from a reference calibration current supplied by the calibration current source; and
transferring the calibration current from the output of said photoreceptor circuit to a sixth current memory cell where said calibration current is stored.

### Claim 26 (depends on 25)

The method of claim 25, wherein during a readout of a pixel circuit, the calibration current stored in the sixth current memory cell is subtracted from the photoreceptor current.
