# US 2021/0067679 A1 · Event sensors with flicker analysis circuitry

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0067679 A1
- Document ID: US20210067679A1
- Status: Published application
- Kind: A1
- Application number: 16/794,573
- Filed: 2020-02-19
- Published: 2021-03-04
- Earliest claimed: 2019-08-28
- Assignees: Semiconductor Components Industries, LLC
- Applicants: Semiconductor Components Industries, LLC
- Inventors: James TORNES
- Web page: https://patentgrep.com/patent/US20210067679A1

## CPC

- H04N 23/745: Detection of flicker frequency or suppression of flicker wherein the flicker is caused by illumination, e.g. due to fluorescent tube illumination or pulsed LED illumination
- H04N 23/71: Circuitry for evaluating the brightness variation
- H04N 25/47: Image sensors with pixel address output; Event-driven image sensors; Selection of pixels to be read out based on image data
- H04N 25/60: Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N 25/78: Readout circuits for addressed sensors, e.g. output amplifiers or A/D converters
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An imaging system may include an event sensor with event sensor pixels. The event sensor pixels may be configured to trigger an “event” if the intensity of light at a pixel changes. Pulse-width modulated light-emitting diode (LED) lighting can cause the image from an event sensor to undulate frame to frame. This may result in false positives when detecting events (because the LED flickering triggers events for the event sensor even though the scene is unchanging to a human viewer). Therefore, the imaging system may include flicker analysis circuitry that is configured to receive light intensity signals from an event sensor pixel. Based on the light intensity signals and the times associated with changes in the light intensity signals, the flicker analysis circuitry may determine an average brightness associated with the LED.

## Claims

### Claim 1

A system comprising:
an event sensor pixel that is exposed to flickering light from a light-emitting diode, wherein the event sensor pixel is configured to output a light intensity signal; and
flicker analysis circuitry that is configured to receive the light intensity signal from the event sensor pixel and output an average brightness value that removes light intensity undulations caused by the flickering light from the light-emitting diode.

### Claim 2 (depends on 1)

The system defined in claim 1, further comprising:
event detection circuitry that is configured to identify events based on the light intensity signal from the event sensor pixel.

### Claim 3 (depends on 2)

The system defined in claim 2, wherein the event detection circuitry is configured to provide light intensity magnitudes associated with the events and time stamps associated with the events to the flicker analysis circuitry.

### Claim 4 (depends on 2)

The system defined in claim 2, wherein the event detection circuitry is configured to provide light intensity magnitudes associated with the events and time stamps associated with the events to a buffer and wherein the flicker analysis circuitry is configured to receive the light intensity magnitudes and the time stamps from the buffer.

### Claim 5 (depends on 1)

The system defined in claim 1, wherein the event sensor pixel includes a photodiode and wherein the light intensity signal is a photocurrent magnitude associated with the photodiode.

### Claim 6 (depends on 1)

The system defined in claim 1, wherein the flicker analysis circuitry is configured to determine the average brightness value using time-averaging of the light intensity signal over one cycle of the light-emitting diode.

### Claim 7 (depends on 1)

The system defined in claim 1, wherein the flicker analysis circuitry is integrated in the event sensor pixel.

### Claim 8 (depends on 1)

The system defined in claim 1, wherein the flicker analysis circuitry is formed separately from the event sensor pixel.

### Claim 9 (depends on 1)

The system defined in claim 1, wherein the event sensor pixel is part of an event sensor that includes an array of event sensor pixels and wherein each event sensor pixel has respective flicker analysis circuitry.

### Claim 10 (depends on 9)

The system defined in claim 9, further comprising:
a frame-based image sensor formed separately from the event sensor.

### Claim 11 (depends on 10)

The system defined in claim 10, wherein the frame-based image sensor has a higher resolution than the event sensor.

### Claim 12 (depends on 11)

The system defined in claim 11, further comprising:
control circuitry configured to correct image data from the frame-based image sensor based on the average brightness value determined by the flicker analysis circuitry.

### Claim 13 (depends on 12)

The system defined in claim 12, further comprising:
a display configured to display the corrected image data from the frame-based image sensor.

### Claim 14

A system that is exposed to flickering light, comprising:
an event sensor comprising a plurality of event sensor pixels that generate first image data;
a frame-based image sensor comprising a plurality of imaging pixels that generate second image data;
flicker mitigation circuitry configured to identify a pattern of the flickering light based on the first image data; and
control circuitry configured to modify the second image data to remove undulations caused by the flickering light based on the pattern of flickering light from the flicker mitigation circuitry.

### Claim 15 (depends on 14)

The system defined in claim 14, wherein each imaging pixel of the plurality of imaging pixels accumulates charge over an integration time.

### Claim 16 (depends on 14)

The system defined in claim 14, wherein the first image data includes light intensity signals and corresponding time stamps.

### Claim 17 (depends on 14)

The system defined in claim 14, further comprising:
a display that is configured to display the modified second image data.

### Claim 18

A method of operating a system that includes an event sensor and flicker analysis circuitry, the method comprising:
obtaining image data using the event sensor;
detecting a flickering pattern in the image data using the flicker analysis circuitry; and
based on the detected flickering pattern, correcting the image data to produce undulation-free output.

### Claim 19 (depends on 18)

The method defined in claim 18, wherein correcting the image data to produce undulation-free output comprises time-averaging a light intensity over the length of time of one flicker cycle.

### Claim 20 (depends on 18)

The method defined in claim 18, wherein the system comprises an additional image sensor formed separately from the event sensor, the method comprising:
correcting additional image data from the additional image sensor based on the detected flickering pattern.
