# US 2025/0097596 A1 · Systems and methods for reducing fixed pattern noise in image data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0097596 A1
- Document ID: US20250097596A1
- Status: Published application
- Kind: A1
- Application number: 18/970,459
- Filed: 2024-12-05
- Published: 2025-03-20
- Earliest claimed: 2012-05-31
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Guy Cote; D. Amnon Silverstein; Suk Hwan Lim; Sheng Lin; Haitao Guo
- Web page: https://patentgrep.com/patent/US20250097596A1

## CPC

- H04N 25/67: applied to fixed-pattern noise, e.g. non-uniformity of response
- H04N 25/673: by using reference sources
- H04N 25/677: for reducing the column or line fixed pattern noise
- H04N 25/683: by defect estimation performed on the scene signal, e.g. real time or on the fly detection
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may be configured to receive a frame of the image data having a plurality of pixels acquired using a digital image sensor. The image processing pipeline may then be configured to determine a first plurality of correction factors that may correct each pixel in the plurality of pixels for fixed pattern noise. The first plurality of correction factors may be determined based at least in part on fixed pattern noise statistics that correspond to the frame of the image data. After determining the first plurality of correction factors, the image processing pipeline may be configured to configured to apply the first plurality of correction factors to the plurality of pixels, thereby reducing the fixed pattern noise present in the plurality of pixels.

## Claims

### Claim 1

A device, comprising:
an interface configured to receive first image data and second image data; and
processing circuitry coupled to the interface, wherein the processing circuitry is configured to:
generate, based on the first image data, a fixed pattern noise statistic;
generate, based on the fixed pattern noise statistic, a first correction factor; and
adjust, based on the first correction factor, the second image data.

### Claim 2 (depends on 1)

The device of claim 1, wherein the first image data corresponds to an image captured during a calibration operation.

### Claim 3 (depends on 1)

The device of claim 1, wherein the fixed pattern noise statistic comprises:
a first gain corresponding to a first noise affecting a first sensor pixel when generating a first portion of the first image data; and
a second gain corresponding to a second noise affecting a second sensor pixel when generating a second portion of the first image data, wherein the first noise is different from the second noise.

### Claim 4 (depends on 1)

The device of claim 1, comprising a sensor coupled to the interface and a mechanical shutter, wherein the processing circuitry is configured to:
operate the mechanical shutter to close;
operate the sensor to generate the first image data while the mechanical shutter is closed;
operate the mechanical shutter to open; and
operate the sensor to generate the second image data while the mechanical shutter is opened.

### Claim 5 (depends on 1)

The device of claim 1, wherein the processing circuitry is configured to adjust the second image data at least in part by subtracting the first correction factor from the second image data.

### Claim 6 (depends on 1)

The device of claim 1, wherein the processing circuitry comprises fixed pattern noise reduction circuitry configured to receive the second image data from level compensation circuitry.

### Claim 7 (depends on 1)

The device of claim 1, wherein the processing circuitry is configured to generate the fixed pattern noise statistic based on a pattern of noise determined by processing respective portions of noise data according to a horizontal pixel coordinate increment and a vertical horizontal pixel coordinate increment.

### Claim 8

A method, comprising:
receiving sensor output data;
generating, based on the sensor output data, a fixed pattern noise statistic;
receiving image data; and
removing a fixed pattern noise affecting a sensor pixel at least in part by adjusting the image data based on the fixed pattern noise statistic.

### Claim 9 (depends on 8)

The method of claim 8, wherein receiving the sensor output data comprises receiving an indication of light sensed by the sensor pixel during a calibration operation.

### Claim 10 (depends on 8)

The method of claim 8, wherein generating the fixed pattern noise statistic based on the sensor output data comprises:
receiving a horizontal coordinate increment parameter and a vertical coordinate increment parameter;
determining a pattern of noise based on processing the sensor output data incrementally using the horizontal coordinate increment parameter and the vertical coordinate increment parameter; and
generating the fixed pattern noise statistic based on the pattern of noise.

### Claim 11 (depends on 8)

The method of claim 8, wherein adjusting the image data based on the fixed pattern noise statistic comprises:
generating a first correction factor based on the fixed pattern noise statistic; and
subtracting the first correction factor from the image data.

### Claim 12 (depends on 8)

The method of claim 8, comprising:
receiving the image data from level compensation circuitry; and
removing the fixed noise pattern from image content at least in part by adjusting the image data based on the fixed pattern noise statistic.

### Claim 13 (depends on 8)

The method of claim 8, wherein generating the fixed pattern noise statistic based on the sensor output data comprises generating the fixed pattern noise statistics based on a noise determined from one or more rows and one or more columns of the sensor output data.

### Claim 14

A non-transitory, computer-readable medium, comprising computer-readable instructions that, when executed by one or more processors of an electronic device, cause the electronic device to:
receive one or more fixed pattern noise statistics indicative of a noise pattern associated with pixels of an image sensor;
adjust image data captured by the image sensor based on the one or more fixed pattern noise statistics; and
send the adjusted image data to downstream circuitry.

### Claim 15 (depends on 14)

The non-transitory, computer-readable medium of claim 14, comprising computer-readable instructions that, when executed by the one or more processors of the electronic device, cause the electronic device to:
operate a mechanical shutter to close;
receive, from a sensor, additional image data while the mechanical shutter is closed; and
generate, based on the additional image data, the one or more fixed pattern noise statistics.

### Claim 16 (depends on 14)

The non-transitory, computer-readable medium of claim 14, comprising computer-readable instructions that, when executed by the one or more processors of the electronic device, cause the electronic device to:
receive, from level compensation circuitry, the image data; and
send, to the downstream circuitry comprising temporal filter circuitry, the adjusted image data.

### Claim 17 (depends on 14)

The non-transitory, computer-readable medium of claim 14, comprising computer-readable instructions that, when executed by the one or more processors of the electronic device, cause the electronic device to receive the one or more fixed pattern noise statistics comprising one or more indications of spatial noise variations between different pixels of an electronic display panel.

### Claim 18 (depends on 14)

The non-transitory, computer-readable medium of claim 14, comprising computer-readable instructions that, when executed by the one or more processors of the electronic device, cause the electronic device to generate the one or more fixed pattern noise statistics at least in part by:
receiving temperature data;
receiving first noise data acquired, via a sensor, at a first time;
receiving second noise data acquired, via the sensor, at a second time; and
generating the one or more fixed pattern noise statistics based on a linear combination of the first noise data, the second noise data, and the temperature data.

### Claim 19 (depends on 14)

The non-transitory, computer-readable medium of claim 14, comprising computer-readable instructions that, when executed by the one or more processors of the electronic device, cause the electronic device to generate the one or more fixed pattern noise statistics at least in part by:
receiving an indication of an integration time associated with a sensor;
receiving first noise data acquired via the sensor at a first time;
receiving second noise data acquired via the sensor at a second time; and
generating the one or more fixed pattern noise statistics based on a linear combination of the first noise data, the second noise data, and the indication of the integration time.

### Claim 20 (depends on 14)

The non-transitory, computer-readable medium of claim 14, comprising computer-readable instructions that, when executed by the one or more processors of the electronic device, cause the electronic device to adjust the image data based on the one or more fixed pattern noise statistics at least in part by:
accessing, based on an index corresponding to a first pixel, a first fixed pattern noise frame in a look-up table, wherein the first fixed pattern noise frame comprises first gain data and first offset data associated with compensating a portion of the image data based on noise affecting the first pixel; and
adjusting, based on the first gain data and the first offset data, the portion of the image data.
