# US 2020/0288073 A1 · Data rate control for event-based vision sensor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0288073 A1
- Document ID: US20200288073A1
- Status: Published application
- Kind: A1
- Application number: 16/884,129
- Filed: 2020-05-27
- Published: 2020-09-10
- Earliest claimed: 2016-12-30
- Assignees: Insightness AG
- Applicants: Insightness AG
- Inventors: Raphaël Berner; Christian Brändli; Massimo Zannoni
- Web page: https://patentgrep.com/patent/US20200288073A1

## CPC

- H04N 25/767: Horizontal readout lines, multiplexers or registers
- H10F 39/8033: {Photosensitive area}
- H04N 25/44: by partially reading an SSIS array
- H04N 25/47: Image sensors with pixel address output; Event-driven image sensors; Selection of pixels to be read out based on image data
- H04N 25/573: {the logarithmic type}
- H04N 25/77: Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
- H04N 25/78: Readout circuits for addressed sensors, e.g. output amplifiers or A/D converters
- H04N 25/778: comprising amplifiers shared between a plurality of pixels, i.e. at least one part of the amplifier must be on the sensor array itself
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H10F: INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION

## Abstract

In dynamic vision sensor (DVS) or change detection sensors, the chip or sensor is configured to control or modulate the event rate. For example, this control can be used to keep the event rate close to a desired rate or within desired bounds. Adapting the configuration of the sensor to the scene by changing the ON-event and/or the OFF-event thresholds, allows having necessary amount of data, but not much more than necessary, such that the overall system gets as much information about its state as possible.

## Claims

### Claim 1

A change detection sensor, comprising:
a pixel array comprising pixels that detect light, wherein the pixels comprise photosensors and photoreceptor circuits that output first signals based on the response of the photosensors;
event detectors for detecting events associated with light received by the pixels by comparing the first signals and a first reference voltage;
an event rate detector for counting the events with a counter; and
a controller for changing how the pixels detect the events based on the event rate detector by changing the first reference voltage;
wherein the controller compares an event rate provided by the event rate detector to a maximum event rate, if the event rate is larger than the maximum event rate the controller changes a time resolution of the sensor.

### Claim 2 (depends on 1)

The sensor as claimed in claim 1, further comprising a threshold generation circuit for setting thresholds applied by the event detectors by providing the first reference voltage.

### Claim 3 (depends on 1)

The sensor as claimed in claim 1, wherein the controller changes the first reference voltage in response to the assessment provided by the event rate detector.

### Claim 4 (depends on 1)

The sensor as claimed in claim 1, wherein the controller sets thresholds for ON events based on ON events in the pixel array based on the counter.

### Claim 5 (depends on 1)

The sensor as claimed in claim 1, wherein each of the pixels comprises a memory capacitor of one of the event detectors for storing a charge corresponding to received light when the pixel was reset.

### Claim 6 (depends on 1)

The sensor as claimed in claim 1, wherein each of the pixels comprises one or more comparators of one of the event detectors for comparing the changes in received light to the first reference voltage and a second reference voltage to detect the events.

### Claim 7 (depends on 1)

The sensor as claimed in claim 1, further comprising comparators of the event detectors for comparing changes in received light to the first reference voltage to detect the events, the comparators being located in a readout circuit.

### Claim 8

A method of operation of a change detection sensor, the method comprising:
detecting light with pixels of a pixel array, wherein the pixels comprise circuits that output first signals based on the response of photosensors of the pixels;
detecting events associated with light received by the pixels by comparing the first signals and a first reference voltage;
counting the events with a counter with an event rate detector;
changing how the pixels detect the events based on the event rate detector by changing the first reference voltage;
comparing an event rate provided by the event rate detector to a maximum event rate; and
if the event rate is larger than the maximum event rate, changing a time resolution of the sensor.

### Claim 9 (depends on 8)

The method as claimed in claim 8, further comprising changing the first reference voltage in response to the assessment provided by the event rate detector.

### Claim 10 (depends on 8)

The method as claimed in claim 8, further comprising setting thresholds for ON events based on ON events in the pixel array based.

### Claim 11 (depends on 8)

The method as claimed in claim 8, wherein each of the pixels comprises a memory capacitor for storing a charge corresponding to received light when the pixel was reset.

### Claim 12 (depends on 8)

The method as claimed in claim 8, wherein each of the pixels comprises one or more comparators for comparing the changes in received light to the first reference voltage and a second reference voltage to detect the events.

### Claim 13 (depends on 8)

The method as claimed in claim 8, further comprising comparing changes in received light to the first reference voltage to detect the events using comparators located in a readout circuit.

### Claim 14

A change detection sensor, comprising:
a pixel array comprising pixels that detect light;
event detectors for detecting ON events associated with light received by the pixels;
an event rate detector for assessing the events; and
a controller for changing how the pixels detect the events based on the event rate detector.

### Claim 15 (depends on 14)

The sensor as claimed in claim 14, wherein the event rate detector comprises a counter for assessing the events by counting the events from the event detectors.

### Claim 16 (depends on 14)

The sensor as claimed in claim 14, wherein the event rate detector comprises an event estimator for assessing the events by estimating events.

### Claim 17 (depends on 14)

The sensor as claimed in claim 14, wherein the event rate detector assesses the events by analyzing an analog signal that is based on the number of event detectors registering events.

### Claim 18 (depends on 14)

The sensor as claimed in claim 14, further comprising a threshold generation circuit for setting thresholds applied by the event detectors.

### Claim 19 (depends on 14)

The sensor as claimed in claim 14, wherein the controller changes the thresholds provided in response to the assessment provided by the event rate detector.

### Claim 20 (depends on 14)

The sensor as claimed in claim 14, wherein the event detectors detect both the ON events and OFF events in the pixel array.

### Claim 21 (depends on 14)

The sensor as claimed in claim 14, wherein each of the pixels comprises a memory capacitor of one of the event detectors for storing a charge corresponding to received light when the pixel was reset.

### Claim 22 (depends on 14)

The sensor as claimed in claim 14, wherein each of the pixels comprises one or more comparators of one of the event detectors for comparing the changes in received light to one or more thresholds to detect the events.

### Claim 23 (depends on 14)

The sensor as claimed in claim 14, further comprising comparators of the event detectors for comparing the changes in received light to one or more thresholds to detect the events, the comparators being located in a readout circuit.

### Claim 24 (depends on 14)

The sensor as claimed in claim 14, wherein the controller sets thresholds for the ON events and OFF events separately based on ON events and OFF events in the pixel array.

### Claim 25 (depends on 14)

The sensor as claimed in claim 14, wherein the event rate detector comprises a counter for assessing the events by counting the events from the event detectors and the counter is periodically reset by the controller.

### Claim 26 (depends on 14)

The sensor as claimed in claim 14, wherein the event rate detector counts a number of both the ON events output by the pixel array and OFF events output by the pixel sensor array, during a given time window using a separate ON event counter and OFF event counter within the counter.

### Claim 27 (depends on 14)

The sensor as claimed in claim 14, wherein the controller reduces the number of events during a sleep cycle and then increases the number of events during normal operating mode.

### Claim 28

A method of operation of a change detection sensor, the method comprising:
detecting ON events associated with light received by pixels in a pixel array;
assessing the events from the pixel array; and
changing how the pixels detect the events based on the assessment of the events from the pixel array.

### Claim 29 (depends on 28)

A method as claimed in claim 28, wherein assessing the events comprises counting the events.

### Claim 30 (depends on 28)

A method as claimed in claim 28, wherein assessing the events comprises estimating the events.

### Claim 31 (depends on 28)

A method as claimed in claim 28, further comprising setting thresholds applied by event detectors for the pixels in response to the assessment of the events.

### Claim 32 (depends on 28)

A method as claimed in claim 28, further comprising setting thresholds for the ON events and OFF events separately based on ON events and OFF events from the pixel array.

### Claim 33

A change detection sensor, comprising:
a pixel array comprising pixels that detect light, wherein the pixels comprise photosensors and photoreceptor circuits that output photosensor signals based on the response of the photosensors;
event detectors for detecting events associated with light received by the pixels by comparing the photosensor signals and a reference voltage;
an event rate detector for assessing the events; and
a controller for changing how the pixels detect the events based on the event rate detector to change the number of events for different modes of the sensor.

### Claim 34 (depends on 33)

A sensor as claimed in claim 33, wherein the modes include a sleep mode and a normal operating mode.

### Claim 35 (depends on 33)

A sensor as claimed in claim 33, wherein a number of events is reduced for the sleep mode and increased for the normal operating mode.
