# US 2016/0259758 A1 · Digital Camera Simulation Using Spatially Varying PSF Convolutions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0259758 A1
- Document ID: US20160259758A1
- Status: Published application
- Kind: A1
- Application number: 14/637,677
- Filed: 2015-03-04
- Published: 2016-09-08
- Earliest claimed: 2015-03-04
- Inventors: Animesh Khemka; Chyuan-Tyng Wu
- Web page: https://patentgrep.com/patent/US20160259758A1

## CPC

- G06F 17/10: Complex mathematical operations {(function generation by table look-up G06F1/03; evaluation of elementary functions by calculation G06F7/544)}
- G06T 5/10: using non-spatial domain filtering
- G06T 5/73: Deblurring; Sharpening
- G06T 5/80: Geometric correction
- G06T 2200/21: involving computational photography
- G06T 2207/20056: Discrete and fast Fourier transform, [DFT, FFT]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A spatially varying PSF may be applied in a camera simulator by multiplying a fixed weight map by its impact region. Next, Fast Fourier Transform (FFT) both IWk and Ak, multiply the FFT results element by element and do an inverse FFT (IFFT) to bring the results back to spatial domain. The output image is exactly the same as the outcome of direct approach with the same interpolation method for spatially varying PSF. However, the operation now will be significantly faster in some embodiments.

## Claims

### Claim 1

A computer implemented method comprising:
weighting an input image signal; and
modelling a spatially varying point spread function of said input signal as a sum of convolutions with fixed point spread functions.

### Claim 2 (depends on 1)

The method of claim 1 including multiplying a fixed weight by its impact region.

### Claim 3 (depends on 2)

The method of claim 2 including fast fourier transforming a weighted input image and a point spread function.

### Claim 4 (depends on 3)

The method of claim 3 including multiplying fast fourier transform results element by element.

### Claim 5 (depends on 4)

The method of claim 4 including inverse fast fourier transforming to get spatial domain results.

### Claim 6

One or more non-transitory computer readable media storing instructions executed by a processor to perform a sequence comprising:
weighting an input image signal; and
modelling a spatially varying point spread function of said input signal as a sum of convolutions with fixed point spread functions.

### Claim 7 (depends on 6)

The media of claim 6, said sequence including multiplying a fixed weight by its impact region.

### Claim 8 (depends on 7)

The media of claim 7, said sequence including fast fourier transforming a weighted input image and a point spread function.

### Claim 9 (depends on 8)

The media of claim 8, said sequence including multiplying fast fourier transform results element by element.

### Claim 10 (depends on 9)

The media of claim 9, said sequence including inverse fast fourier transforming to get spatial domain results.

### Claim 11

An apparatus comprising:
a device to weight an input image signal; and
a unit to model a spatially varying point spread function of said input signal as a sum of convolutions with fixed point spread functions.

### Claim 12 (depends on 11)

The apparatus of claim 11 including a multiplier to multiply a fixed weight by its impact region.

### Claim 13 (depends on 12)

The apparatus of claim 12 including fast fourier transform device to transform a weighted input image and a point spread function.

### Claim 14 (depends on 13)

The apparatus of claim 13 including a multiplier to multiply the fast fourier transform results element by element.

### Claim 15 (depends on 14)

The apparatus of claim 14 including an inverse fast fourier transform device to provide spatial domain results.

### Claim 16

A camera simulator comprising:
an optics simulator including:
a multiplier to receive raw images and a fixed weight map and to multiply the fixed weight map by its impact region;
a fast fourier transform to receive weights multiplied by an image I and to convolve with a point spread function; and
an image signal processing simulator coupled to same optics simulator.

### Claim 17 (depends on 16)

The simulator of claim 16 including a multiplier coupled to said transform multiply said transform results element by element.

### Claim 18 (depends on 17)

The simulator of claim 17 including a inverse fast fourier transform to inverse transform the results of said element by element multiplication.

### Claim 19 (depends on 16)

The simulator of claim 16 including a display communicatively coupled to the circuit.

### Claim 20 (depends on 16)

The simulator of claim 16 including a battery coupled to the circuit.
