# US 2019/0174078 A1 · Recovery of pixel resolution in scanning imaging

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0174078 A1
- Document ID: US20190174078A1
- Status: Published application
- Kind: A1
- Application number: 16/322,009
- Filed: 2017-09-28
- Published: 2019-06-06
- Earliest claimed: 2016-09-28
- Assignees: Versitech Limited
- Applicants: Versitech Limited
- Inventors: Kin Man, Kevin TSIA; Chi Shing, Antony CHAN
- Web page: https://patentgrep.com/patent/US20190174078A1

## CPC

- H04N 25/48: Increasing resolution by shifting the sensor relative to the scene
- G01N 15/147: {the analysis being performed on a sample stream}
- G01N 15/1484: {microstructural devices}
- G06T 3/4053: based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
- G06T 3/4069: by subpixel displacements
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

This invention describes a technique to enhance pixel resolution of high-speed laser scanning imaging by the means of sub-pixel sampling, applicable to one-dimensional (1D), two-dimensional (2D), and three-dimensional (3D) imaging.

## Claims

### Claim 1

A method of enhancing pixel resolution of high speed laser scanning imaging to enhance pixel resolution of high-speed laser scanning imaging by the means of sub-pixel sampling, applicable to one-dimensional (1D), two-dimensional (2D), and three-dimensional (3D) imaging.

### Claim 2 (depends on 1)

The method of claim 1, wherein enhancing pixel resolution of high-speed laser scanning imaging by the means of sub-pixel sampling comprises restoring high-resolution (HR) image information from multiple subpixel-shifted, low-resolution (LR) images captured by a lower sampling rate of a digitizer by means of subpixel shift of consecutive line scans during imaging naturally generated by the mismatch between laser-scan repetition frequency of the high speed laser scanning imaging and sampling rate of the digitizer.

### Claim 3 (depends on 1)

The method of claim 1, wherein the high speed laser scanning imaging includes on-the-fly line scan imaging of a specimen,
wherein on-the-fly line scan refers to the relative motion between the specimen and the laser line-scan beam.

### Claim 4 (depends on 3)

The method of claim 3, wherein the on-the fly line scan imaging of a specimen comprises applying 1D line-scanning to the specimen with unidirectional motion, and reconstructing 2D image by digitally stacking the captured 1D line scans, and wherein a fast axis of the resultant 2D image corresponds to the line-scan direction, and a slow axis corresponds to the specimen motion direction.

### Claim 5 (depends on 3)

The method of claim 3, wherein the on-the fly line scan imaging of a specimen comprises applying 2D line-scanning to the specimen by scanning the line-scan beam along the slow axis, and reconstructing 2D image by digitally stacking the captured 1D line scans, and wherein a fast axis of the resultant 2D image corresponds to the line-scan direction, and a slow axis corresponds to the line-scan beam motion direction.

### Claim 6 (depends on 3)

The method of claim 3, wherein the on-the fly line scan imaging of a specimen comprises applying 3D line-scanning to the specimen by scanning the line-scan beam along the slow axis and axial axes, and reconstructing 3D image by digitally stacking the captured 1D line scans along the slow and axial axes, and wherein a fast axis of the resultant 3D image corresponds to the line-scan direction, and a slow and axial axes corresponds to the line-scan beam motion directions.

### Claim 7 (depends on 4)

The method of claim 4, further comprises harnessing a warping effect of the resultant 2D or 3D image to creating the relative subpixel shift on the fast axes, slow axes and axial axes so as to restore a high-resolution 2D or 3D image, wherein the warping effect is caused by pixel drift between adjacent line-scans as the sampling rate f of the digitizer is unlocked from the laser pulse repetition rate F of the high speed laser scanning imaging.

### Claim 8 (depends on 5)

The method of claim 5, wherein harnessing the warping effect of the resultant 2D or 3D image to creating the relative subpixel shift on both the fast axis and slow axis is implemented by the following steps:
introducing a predetermined non-uniform illumination background of 1D line-scan as the reference for compensating the warping of the 2D or 3D image;
registering an warp angle θ in a high-resolution grid of the multiple captured line-scan images, comprising:
dewarping the image with a dewarp filter at a given warp angle θ;
obtaining an accurate value θ by maximizing the “cleanliness” of the extracted foreground, i.e. minimizing the energy or band-like artefacts of a foreground;
subtracting the dewarped image with 1D reference illumination background;
restoring the 2D or 3D image by interleaving the LR line-scan images; and
denoising and re-sampling the restored 2D or 3D image into the high-resolution grid, and revealing the high-resolution information.

### Claim 9 (depends on 8)

The method of claim 8, wherein the predetermined non-uniform illumination background of the 1D line-scan comprises a laser spectrum in time-stretch imaging or varying/modulating the illumination intensity during scanning.

### Claim 10 (depends on 9)

The method of claim 9, wherein obtaining an accurate value {circumflex over (θ)} by minimizing the energy of the foreground is expressed as:
θ
^
=
arg


min
θ

∫
0
N


Δ


x

∫
0
M


Δ


y

[
W
θ
-
1

[
I

(
x
,
y
)
]
-
I
B
′

(
x
)

|
θ
]
2

dydx
,
wherein, the integer N is the number of pixels of each line scan; function Wθ−1[·] is the image dewarp filter at angle θ, and I′B(x)|θ is the estimated non-uniform illumination profile introduced in the system.

### Claim 11 (depends on 2)

The method of claim 2, wherein the lower sampling rate of the digitizer is as low as mega-samples per second and the laser-scan repetition frequency of the high speed laser scanning imaging F>>0.1 MHz.

### Claim 12 (depends on 1)

The method of claim 1, wherein enhancing pixel resolution of high-speed laser scanning imaging by the means of sub-pixel sampling comprises locking the digitizer sampling clock to the laser pulse trigger with a phase-lock loop (PLL) at a fractional ratio P/Q.

### Claim 13 (depends on 1)

A system for enhancing pixel resolution of high speed laser scanning imaging to enhance pixel resolution of high-speed laser scanning imaging by the means of sub-pixel sampling, applicable to one-dimensional (1D), two-dimensional (2D), and three-dimensional (3D) imaging, the system comprises:
a high speed laser scanning imager;
a digitizer for capturing low-resolution (LR) images at lower sampling rate; and
a processor and a memory, wherein the memory stores a computer program, the program being executed by the processor to implement the method of claim 1.
