# US 2018/0047161 A1 · Multi-Spectral Three Dimensional Imaging System and Method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0047161 A1
- Document ID: US20180047161A1
- Status: Published application
- Kind: A1
- Application number: 15/723,585
- Filed: 2017-10-03
- Published: 2018-02-15
- Earliest claimed: 2015-05-21
- Assignees: inviCro, LLC
- Applicants: inviCRO LLC
- Inventors: Robert W. Holt; Mohammed Q. Qutaish; John W. Hoppin; Marc E. Seaman; Jacob Y. Hesterman
- Web page: https://patentgrep.com/patent/US20180047161A1

## CPC

- G06T 7/0012: {Biomedical image inspection}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- G01N 21/6428: {Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" (in vivo A61B5/00; immunoassay G01N33/53)}
- G01N 21/6456: {Spatial resolved fluorescence measurements; Imaging}
- G01N 23/046: using tomography, e.g. computed tomography [CT]
- G06T 5/73: Deblurring; Sharpening
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- A61B 5/0073: {by tomography, i.e. reconstruction of 3D images from 2D projections (A61B5/0066 takes precedence)}
- A61B 5/0507: using microwaves or terahertz waves
- A61B 5/0536: Impedance imaging, e.g. by tomography
- A61B 2503/42: for laboratory research
- A61B 2576/00: Medical imaging apparatus involving image processing or analysis (A61B1/00009, A61B6/52 and A61B8/52 take precedence)
- G01N 2021/6441: {with two or more labels}
- G06T 2207/10012: Stereo images
- G06T 2207/10064: Fluorescence image
- G06T 2207/10072: Tomographic images
- G06T 2207/10152: Varying illumination
- G06T 2207/30024: Cell structures in vitro; Tissue sections in vitro
- G06T 2207/30101: Blood vessel; Artery; Vein; Vascular
- G16H 30/40: for processing medical images, e.g. editing
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

A processor receives a first image of a first section of a specimen contacted with at least one first fluorophore having an emission spectrum in the range of approximately 200 nm to 1000 nm, the first image created using a first wavelength of invisible light. The processor receives a second image of a second section of the specimen, the second section adjacent to the first section and the second image created using the first wavelength of invisible light. The processor co-registers the first image and the second image. The processor creates a single-plane image of the first section using a next-image process; wherein the creating of the image includes a debluring process. The processor receives an image of a third section of the specimen created using the first wavelength of invisible light. The processor creates a 3D image of the specimen using at least three images of adjacent specimen sections.

## Claims

### Claim 1

A computer-implemented method of creating an image of a specimen wherein the specimen is contacted with at least one first fluorophore having an emission spectrum in the range of approximately 200 nm to 1000 nm, the method comprising the steps of:
i. receiving, by a processor, a first image Nx of a first section Sx of a specimen, the first image created using a first wavelength of invisible light;
ii. receiving, by the processor, a second image Nx+1 of a second section Sx+1 of the specimen, the second section Sx+1 being adjacent to the first section Sx and the second image created using the first wavelength of invisible light;
iii. co-registering, by the processor, the first image and the second image;
iv. creating, by the processor, a single-plane image of the first section using a next-image process; wherein the creating of the image includes a debluring process;
v. receiving, by the processor, an image Nx+3 of a third section Sx+3 of the specimen created using the first wavelength of invisible light; and,
vi. creating, by the processor, a 3D image of the specimen using at least three images of adjacent specimen sections.

### Claim 2 (depends on 1)

The method of claim 1, wherein the step of receiving, by a processor, includes receiving a visible light image Vx of the first section Sx of the specimen created using white light.

### Claim 3 (depends on 1)

The method of claim 1, wherein the method includes reiterating the processes of steps i. through vii for receiving images Nx for a next section Sx of a specimen, where x=2 and increments by 1 for each iteration.

### Claim 4 (depends on 2)

The method of claim 2, wherein the method includes reiterating the processes of steps i. through vii for receiving images Nx and Vx for a next section Sx of a specimen, where x=2 and increments by 1 for each iteration; and co-registering, by the processor, the visible light images of the section of the specimen

### Claim 5 (depends on 1)

The method of claim 1, wherein the de-blurring process includes one of subsurface fluorescence removal, resolving an aberration in camera optics or physical correction.

### Claim 6 (depends on 1)

The method of claim 1, wherein the specimen is contacted with the first fluorophore, and a second, different fluorophore, said second fluorophore having an emission spectrum in the range of, but not limited to, approximately 200 nm to 1000 nm.

### Claim 7 (depends on 4)

The method of claim 4, further comprising:
determining a tissue type from an image and wherein the de-blurring is performed based on the tissue type.

### Claim 8 (depends on 7)

The method of claim 7 wherein determining the tissue type is from a visible light image, an invisible light image, or an invisible light image in combination with a visible light image.

### Claim 9 (depends on 7)

The method of claim 7 wherein the tissue type is determined by a processor using a classification algorithm based on a stored history or library.

### Claim 10 (depends on 5)

The method of claim 5, wherein the de-blurring includes one of an analytical solution, a Monte Carlo simulation, a point spread function method, and a deconvolution method.

### Claim 11 (depends on 10)

The method of claim 10, wherein the deconvolution method includes one of: a measured point spread function kernel, a simulated point spread function kernel, a Richardson-Lucy method, a Weiner filter deconvolution, a Van Cittert deconvolution, a blind deconvolution, and a regularized deconvolution method.

### Claim 12 (depends on 1)

The method of claim 1, further comprising:
receiving, by the processor, an image of the first section of the specimen created using visible light.

### Claim 13

A system for creating an image of a specimen comprising:
a light source;
an image capture device;
a whitelight light source;
a processor configured to:
receive a first image of a first section of a specimen, the first image created using a first wavelength of invisible light;
receive a second image of a second section of the specimen, the second section being adjacent to the first section and the second image created using the first wavelength of invisible light;
co-register the first image and the second image; and
create a single-plane image of the first section using a next-image process;
receive a first whitelight light image of the first section of the specimen created using white light; and
co-register the images of the first section of the specimen.

### Claim 14 (depends on 13)

The system of claim 13, wherein the processor is further configured to:
receive an Nth image of an Nth section of the specimen created using the first wavelength of invisible light; and
create a 3D image of the specimen using at least three images of adjacent specimen sections.

### Claim 15 (depends on 14)

The system of claim 14, wherein the creating of the 3D image is performed via a next-image process.

### Claim 16 (depends on 13)

The system of claim 13, wherein the specimen is contacted with at least one first fluorophore having an emission spectrum in the range of approximately 200 nm to 1000 nm.

### Claim 17 (depends on 13)

The system of claim 13, wherein the specimen is contacted with a first fluorophore and a second, different fluorophore, said second fluorophore having an emission spectrum in the range of approximately 200 nm to 1000 nm.

### Claim 18 (depends on 13)

The system of claim 13, wherein the processor is further configured to:
receive a third image of the first section of the specimen, the third image created using a second wavelength of invisible light;
receive a fourth image of a second section of the specimen, the fourth image created using the second wavelength of invisible light;
co-register the third image and the fourth image; and
create a single-plane image of the first section using a next-image process.

### Claim 19 (depends on 18)

The system of claim 18, wherein the processor is further configured to de-blur the first image.

### Claim 20 (depends on 18)

The system of claim 18, further comprising:
determining a tissue type from a visible light image, wherein the de-blurring is performed based on tissue type.

### Claim 21 (depends on 19)

The system of claim 19, wherein the de-blurring includes one of an analytical solution to optical transport, a Monte Carlo simulation, a point spread function method, and a deconvolution method.

### Claim 21 (depends on 19)

The system of claim 19, wherein the deconvolution method includes one of a measured point spread function kernel, a simulated point spread function kernel, a Richardson-Lucy method, a Weiner filter deconvolution, a Van Cittert deconvolution, a blind deconvolution, and a regularized deconvolution method.

### Claim 22 (depends on 12)

The system of claim 12, further comprising:
a display in communication with the processor.
