# US 2001/0024534 A1 · Super resolution methods for electro-optical systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2001/0024534 A1
- Document ID: US20010024534A1
- Status: Published application
- Kind: A1
- Application number: 09/855,557
- Filed: 2001-05-16
- Published: 2001-09-27
- Earliest claimed: 1998-05-20
- Assignees: ITT Manufacturing Enterprises, Inc.
- Inventors: Donald David Gregory; Peter Michael Mantica; Stephen Charles Cain; Douglas Lent Cohen; John Bourne Abbiss
- Web page: https://patentgrep.com/patent/US20010024534A1

## CPC

- G06T 3/4053: based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
- G06T 5/20: using local operators
- G06T 5/70: Denoising; Smoothing
- G06T 5/73: Deblurring; Sharpening
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

In an optical system having a detector means and processor means in which imaging data is obtained comprising noisy blurred scene data containing an object to be reconstructed, and noisy blurred background data of the same scene, a method for increasing the spatial resolution of the imaging data produced by the optical system, comprising the steps of converting the imaging data into a first matrix, regularizing the first matrix by performing nth order Tikhonov regularization to the first matrix to provide a regularized pseudo-inverse (RPI) matrix and applying the RPI matrix to the first matrix to provide a reconstructed image of the object.

## Claims

### Claim 1

In an optical system having a detector means and processor means in which imaging data is obtained comprising noisy blurred scene data containing an object to be reconstructed, and noisy blurred background data of the same scene, a method for increasing the spatial resolution of the imaging data produced by the optical system for providing an image of higher resolution, comprising the steps of:
converting the imaging data into a first matrix;
regularizing the first matrix by performing nth order Tikhonov regularization to the first matrix to provide a regularized pseudo-inverse (RPI) matrix; and
applying the RPI matrix to the first matrix to provide a reconstructed image of the object.

### Claim 2 (depends on 1)

The method of claim 1 wherein the optical system is diffraction limited.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the RPI matrix is determined via a singular value decomposition (SVD) of the first matrix obtained from the point spread function of the optical system.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the RPI matrix is determined using QR decomposition of the first matrix.

### Claim 5

A method for substantially increasing the spatial resolution of imaging data produced by an optical system, comprising the steps of:
converting the imaging data into a first matrix g1, comprising background data and object of interest data, and a second matrix g2 comprising background data;
subtracting the second matrix g2 from the first matrix g1 to obtain a third matrix g3 indicative of the difference between the first and second matrices,
specifying a position and size of an object of interest in the third matrix g3;
extracting from the third matrix g3 a segment having coordinates which completely include a blurred version of the object of interest;
performing nth order Tikhonov regularization on each such extracted segment and said second matrix to restore the segment, adding such restored segments, and extracting an area of the added restored segments containing an object of interest to obtain restored image data containing a restored object of interest.

### Claim 6 (depends on 5)

The method according to claim 5, wherein the first matrix comprises an image scene containing the object of interest and background data, and wherein the second matrix comprises the image scene containing only the background data.

### Claim 7 (depends on 5)

The method according to claim 5, further comprising the step of low pass filtering the first and second matrices to the system cutoff frequency.

### Claim 8 (depends on 6)

The method according to claim 6, wherein the step of extracting a segment having coordinates which completely include a blurred version of an object of interest comprises extracting an area equal to the extent of such object of interest plus the diffracted energy associated with the object of interest.

### Claim 9 (depends on 5)

The method of claim 5 wherein the optical system is diffraction limited.

### Claim 10 (depends on 8)

The method of claim 8 wherein the optical system is diffraction limited.

### Claim 11

In an optical system having a detector means and processor means in which image data is obtained comprising noisy blurred scene data containing an object to be reconstructed, and noisy blurred background data of the same scene, an apparatus for increasing the spatial resolution of the imaging data produced by the optical system for providing an image of higher resolution, comprising:
means for converting the imaging data into a first matrix;
means for regularizing the first matrix by performing nth order Tikhonov regularization to the first matrix to provide a regularized pseudo-inverse (RPI) matrix; and
means for applying the RPI matrix to the first matrix to provide a reconstructed image of said object.

### Claim 12 (depends on 11)

The apparatus of claim 11 wherein the optical system is diffraction limited.

### Claim 13 (depends on 11)

The apparatus of claim 11 wherein the optical system has a numerical aperture and the detector means has at least five detectors spread across the central lobe of the diffraction pattern determined by the numerical aperture.

### Claim 14 (depends on 11)

The apparatus of claim 11, wherein the RPI matrix is determined via a singular value decomposition (SVD) of the first matrix obtained from the point spread function of the optical system.

### Claim 15 (depends on 11)

The apparatus of claim 11, wherein the RPI matrix is determined using QR decomposition of the first matrix.

### Claim 16

An apparatus for substantially increasing the spatial resolution of imaging data produced by an optical system comprising:
means for converting the imaging data into a first matrix g1 comprising background data and object of interest data, and a second matrix g2 comprising background data;
means for subtracting the second matrix g2 from the first matrix g1 to obtain a third matrix g3 indicative of the difference between said first and second matrices;
means for specifying a position and a size of an object of interest in the third matrix g3;
means for extracting from the third matrix at least a segment having coordinates which completely include a blurred version of the object of interest; and
means for performing nth order Tikhonov regularization on each such extracted segment and said second matrix to restore the segment, adding said restored segments, and extracting an area of added restored segments containing the object of interest to obtain the restored image data containing a restored object of interest.

### Claim 17 (depends on 16)

The apparatus of claim 16 wherein the optical system is diffraction limited.

### Claim 18 (depends on 16)

The apparatus of claim 16 wherein the optical system has a numerical aperture and the detector means has at least five detectors spread across the central lobe of the diffraction pattern determined by the numerical aperture.

### Claim 19 (depends on 16)

The apparatus of claim 16, wherein the first matrix comprises an image scene containing an object of interest and background data, and wherein the second matrix comprises the image scene containing only background data.

### Claim 20 (depends on 19)

The apparatus of claim 19, further comprising means for low pass filtering the first and second matrices to the system cutoff frequency.

### Claim 21 (depends on 19)

The apparatus of claim 19, wherein the means for extracting at least a segment having coordinates which completely include a blurred version of the object of interest comprises means for extracting an area equal to the extent of the object of interest plus the diffracted energy associated with the object of interest.
