# US 8,279,329 B2 · Structured illumination for imaging of stationary and non-stationary, fluorescent and non-fluorescent, objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,279,329 B2
- Document ID: US8279329B2
- Status: Granted
- Kind: B2
- Application number: 12/100,723
- Filed: 2008-04-10
- Published: 2009-02-19
- Granted: 2012-10-02
- Earliest claimed: 2007-04-10
- Assignees: University of Rochester
- Inventors: Sapna Shroff; David R. Williams; James Fienup
- Web page: https://patentgrep.com/patent/US8279329B2

## CPC

- A61B 3/12: for looking at the eye fundus, e.g. ophthalmoscopes (A61B3/13 takes precedence)
- A61B 3/10: Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B 5/0059: {using light, e.g. diagnosis by transillumination, diascopy, fluorescence (photoacoustic A61B5/0093; optical measurement of heart rate A61B5/02416; optical measurement of blood flow A61B5/0261; optical measurement of analytes A61B5/1455)}
- A61B 5/7257: {using Fourier transforms}
- G01N 21/45: using interferometric methods; using Schlieren methods
- G01N 21/6458: {Fluorescence microscopy (fluorescence microscopes per se G02B21/0076 and G02B21/16)}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)

## Abstract

An object to be imaged is illuminated with a structured (e.g., sinusoidal) illumination at a plurality of phase shifts to allow lateral superresolution and axial sectioning in images. When an object is to be imaged in vitro or in another situation in which the phase shifts cannot be accurately determined a priori, the images are taken, and the phase shifts are estimated a posteriori from peaks in the Fourier transforms. The technique is extended to the imaging of fluorescent and non-fluorescent objects as well as stationary and non-stationary objects.

## Claims

### Claim 1

A method for imaging an object, the method comprising:
(a) applying a structured periodic illumination to the object a plurality of times with a plurality of phase shifts of the structured illumination caused by relative movement between the structured illumination and the object;
(b) taking a plurality of images of the object corresponding to the plurality of phase shifts;
(c) estimating the plurality of phase shifts by determining a phase of a peak of a Fourier transform of each of the images taken in step (b) by a processor; and
(d) reconstructing a 2-D image or 3-D image of the object using the plurality of images taken in step (b) and the plurality of phase shifts estimated in step (c).

### Claim 2 (depends on 1)

The method of claim 1, wherein the object is stationary during step (b).

### Claim 3 (depends on 2)

The method of claim 2, wherein the object is fluorescent.

### Claim 4 (depends on 3)

The method of claim 3, wherein step (a) is performed with coherent illumination.

### Claim 5 (depends on 3)

The method of claim 3, wherein step (a) is performed with non-coherent illumination.

### Claim 6 (depends on 2)

The method of claim 2, wherein the object is non-fluorescent.

### Claim 7 (depends on 6)

The method of claim 6, wherein step (a) is performed with coherent illumination.

### Claim 8 (depends on 6)

The method of claim 6, wherein step (a) is performed with non-coherent illumination.

### Claim 9 (depends on 1)

The method of claim 1, wherein the object is non-stationary during step (b).

### Claim 10 (depends on 9)

The method of claim 9, wherein the object is fluorescent.

### Claim 11 (depends on 10)

The method of claim 10, wherein step (a) is performed with coherent illumination.

### Claim 12 (depends on 10)

The method of claim 10, wherein step (a) is performed with non-coherent illumination.

### Claim 13 (depends on 9)

The method of claim 9, wherein the object is non-fluorescent.

### Claim 14 (depends on 13)

The method of claim 13, wherein step (a) is performed with coherent illumination.

### Claim 15 (depends on 13)

The method of claim 13, wherein step (a) is performed with non-coherent illumination.

### Claim 16 (depends on 9)

The method of claim 9, wherein the phase shifts estimated in step (c) are caused at least partially by movement of the object.

### Claim 17 (depends on 1)

The method of claim 1, wherein the object is fluorescent.

### Claim 18 (depends on 1)

The method of claim 1, wherein step (a) is performed with coherent illumination.

### Claim 19 (depends on 18)

The method of claim 18, wherein step (a) comprising changing an angle of illumination of the object to reduce speckle.

### Claim 20 (depends on 1)

The method of claim 1, wherein step (a) is performed with non-coherent illumination.

### Claim 21 (depends on 1)

The method of claim 1, wherein the object is non-fluorescent.

### Claim 22 (depends on 1)

The method of claim 1, wherein step (a) is performed with coherent illumination.

### Claim 23 (depends on 1)

The method of claim 1, wherein step (a) is performed with non-coherent illumination.

### Claim 24 (depends on 1)

The method of claim 1, wherein step (d) comprises forming a lateral superresolution image of the object.

### Claim 25 (depends on 1)

The method of claim 1, wherein step (d) comprises forming an axially sectioned image of the object.

### Claim 26 (depends on 25)

The method of claim 25, wherein step (d) further comprises forming a lateral superresolution image of the object.

### Claim 27 (depends on 1)

The method of claim 1, wherein step (a) comprises applying the structured periodic illumination at a plurality of angular orientations.

### Claim 28 (depends on 1)

The method of claim 1, wherein the phase shifts estimated in step (c) are caused at least partially by moving an optical element.

### Claim 29 (depends on 1)

The method of claim 1, wherein the phase shifts estimated in step (c) are caused at least partially by moving the object.

### Claim 30 (depends on 1)

The method of claim 1, wherein the phase shifts estimated in step (c) are used in phase shift calibrations.

### Claim 31

A system for imaging an object, the system comprising:
optics for applying a structured periodic illumination to the object a plurality of times with a plurality of phase shifts of the structured illumination caused by relative movement between the structured illumination and the object;
an imaging device for taking a plurality of images of the object corresponding to the plurality of phase shifts; and
a processor, in communication with the imaging device, for estimating the plurality of phase shifts by determining a phase of a peak of a Fourier transform of each of the images and reconstructing a 2-D image or 3-D image of the object using the plurality of images and the plurality of phase shifts.

### Claim 32 (depends on 31)

The system of claim 31, wherein the optics comprise a source of coherent illumination.

### Claim 33 (depends on 32)

The system of claim 32, wherein the optics comprise an optical element for forming interference fringes on the object.

### Claim 34 (depends on 33)

The system of claim 33, wherein the optics comprise a grating.

### Claim 35 (depends on 31)

The system of claim 31, wherein the optics comprise a source of non-coherent illumination.

### Claim 36 (depends on 31)

The system of claim 31, wherein the processor forms a lateral superresolution image of the object.

### Claim 37 (depends on 31)

The system of claim 31, wherein the processor forms an axially sectioned image of the object.

### Claim 38 (depends on 37)

The system of claim 37, wherein the processor also forms a lateral superresolution image of the object.

### Claim 39 (depends on 31)

The system of claim 31, wherein the optics apply the structured periodic illumination at a plurality of angular orientations.

### Claim 40 (depends on 31)

The system of claim 31, wherein the optics comprise an optical element that is controllable to apply the plurality of phase shifts.

### Claim 41 (depends on 40)

The system of claim 40, wherein the optics further comprise a device for moving the optical element to apply the plurality of phase shifts.

### Claim 42 (depends on 41)

The system of claim 41, wherein the optical element comprises a grating.

### Claim 43 (depends on 31)

The system of claim 31, further comprising a device for moving the object to apply the plurality of phase shifts.

### Claim 44 (depends on 31)

The system of claim 31, wherein the estimated phase shifts are used in phase shift calibrations.

### Claim 45 (depends on 1)

The method of claim 1, wherein, in step (c), the Fourier transform is a spatial-frequency Fourier transform.

### Claim 46 (depends on 31)

The system of claim 31, wherein the processor is configured such that the Fourier transform is a spatial-frequency Fourier transform.
