# US 2016/0252718 A1 · Improvements in or relating to super-resolution microscopy

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0252718 A1
- Document ID: US20160252718A1
- Status: Published application
- Kind: A1
- Application number: 15/030,850
- Filed: 2014-10-21
- Published: 2016-09-01
- Earliest claimed: 2013-10-21
- Assignees: University of Leicester
- Applicants: University of Leicester
- Inventors: Nicholas Anthony Hartell
- Web page: https://patentgrep.com/patent/US20160252718A1

## CPC

- G02B 21/367: {providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison}
- G02B 21/06: Means for illuminating specimens
- G02B 21/361: {Optical details, e.g. image relay to the camera or image sensor (G02B21/364 takes precedence; illumination details G02B21/06 and subgroups)}
- G02B 27/58: Optics for apodization or superresolution; Optical synthetic aperture systems
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

The present invention relates to a method of processing images captured following structured illumination of a sample, the method comprising the steps of: identifying emission spots within each captured image; verifying the emission spots; and reconstructing an enhanced image of the sample from the emission spots. The method may comprise identifying only in focus emission spots. By identifying and processing only in focus spots, whether or not they are centred on expected illumination positions, improvements in resolution can be achieved compared to known SIM methods. In particular, by suitable selection of in focus spots, significant improvements in lateral and axial resolution can be achieved.

## Claims

### Claim 1

A method of processing images captured following structured illumination of a sample, the method comprising the steps of:
identifying emission spots within each captured image;
verifying the emission spots; and
reconstructing an enhanced image of the sample from the emission spots.

### Claim 2 (depends on 1)

A method as claimed in claim 1 wherein the method comprises the steps of:
identifying emission spots within each captured image;
determining the centre of each identified spot;
extracting a subimage concentric with each identified spot;
enhancing each subimage;
replacing the extracted subimages with the enhanced subimages; and
generating an enhanced image comprising the enhanced subimages.

### Claim 3 (depends on 1)

A method as claimed in claim 1 wherein the step of identifying emission spots comprises iteratively fitting multiple point spread functions to regions of image data which appear to contain overlapping signals.

### Claim at position 4

-5. (canceled)

### Claim 6 (depends on 1)

A method as claimed in claim 1, wherein the step of identifying emission spots comprises the steps of:
extracting emission spot co-ordinates from potentially overlapping image data by first calculating the expected image from each possible emission spot position; and
determining the emission spot positions that give rise to real signals in light of this complete prior knowledge.

### Claim 7 (depends on 1)

A method as claimed in claim 1, wherein the step of reconstructing an enhanced image comprises the steps of calculating a 2D histogram of the emission spot positions with a chosen square bin size, which may correspond to the pixel size of the composite image; and displaying the histogram as a pixelated image whose local intensity is proportional to the bin occupancy.

### Claim 8 (depends on 1)

A method as claimed in claim 1, wherein the step of reconstructing an enhanced image comprises forming a Quad-Tree Based Adaptive Histogram based on a quad-tree representation of the localization data.

### Claim 9 (depends on 1)

A method according to claim 1, wherein only in focus spots, are identified and processed, wherein in focus spots are identified if their diameters match the diameter of the expected point spread function (PSF) of the collection optics.

### Claim 10

(canceled)

### Claim 11 (depends on 1)

A method according to claim 1, wherein spots are identified using a generalised likelihood ratio test (GLRT) segmentation method based on spot diameter and signal to noise ratio.

### Claim at position 11

-18. (canceled)

### Claim 19 (depends on 8)

A method as claimed in claim 8, wherein the method includes the further step of selecting the axial focus of the images by selecting the PSF diameter and/or threshold value.

### Claim 20 (depends on 1)

A method as claimed in claim 1, wherein the centre of each identified spot is determined by using nonlinear curve fitting of a symmetric Gaussian function with a fixed standard deviation.

### Claim 21

(canceled)

### Claim 22 (depends on 2)

A method as claimed in claim 2, wherein subimage enhancement is carried out using a Gaussian mask or scaling the subimage.

### Claim 23

(canceled)

### Claim 24 (depends on 1)

A method as claimed in claim 1, wherein the method includes the further step of generating a composite image from a sequence of enhanced images.

### Claim 25 (depends on 24)

A method as claimed in claim 24 wherein the method includes the additional steps of generating composite images under differing conditions and comparing said composite images.

### Claim 26 (depends on 24)

A method as claimed in claim 24 wherein the method includes the steps of comparing emissions spots at said selected locations over the sequence of images used to generate a composite image.

### Claim 27 (depends on 1)

A super-resolution imaging technique comprising the steps of:
selectively illuminating a series of separated points of a specimen;
capturing images resulting from said illumination; and
processing said images according to the method of claim 1.

### Claim at position 21

-29. (canceled)

### Claim 30 (depends on 27)

A method as claimed in claim 27, wherein the illuminated spots are arranged according to a grid pattern determined iteratively.

### Claim at position 23

-33. (canceled)

### Claim 34 (depends on 27)

A method as claimed in claim 27, wherein each illumination pattern is used to generate an enhanced image.

### Claim 35 (depends on 34)

A method as claimed in claim 34 wherein the method includes the further step of generating a composite image from a sequence of enhanced images, wherein the number of images in the sequence is related to the number of illumination points in an illumination pattern.

### Claim 36

(canceled)

### Claim 37 (depends on 1)

An apparatus for super-resolution imaging, the apparatus comprising:
a programmable illumination arrangement operable to selectively illuminate a series of separated points of a specimen;
a detection arrangement operable to capture images resulting from said illumination; and
processing means operable to process captured images according to the method of claim 1.

### Claim at position 28

-41. (canceled)

### Claim 42 (depends on 37)

An apparatus as claimed in claim 37, wherein the programmable illumination arrangement comprises:
a laser beam steering means including acousto-optic deflectors (AODs);
and compensation means including an acousto-optic modulator (AOM).

### Claim at position 30

-52. (canceled)
