# US 2021/0341389 A1 · Simultaneous top-down and rotational side-view fluorescence imager for excised tissue

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0341389 A1
- Document ID: US20210341389A1
- Status: Published application
- Kind: A1
- Application number: 16/865,044
- Filed: 2020-05-01
- Published: 2021-11-04
- Earliest claimed: 2020-05-01
- Assignees: LI-COR, Inc.
- Applicants: LI-COR, Inc.
- Inventors: Han-Wei Wang; Lyle R. Middendorf
- Web page: https://patentgrep.com/patent/US20210341389A1

## CPC

- G01N 21/6456: {Spatial resolved fluorescence measurements; Imaging}
- G01N 21/6486: {Measuring fluorescence of biological material, e.g. DNA, RNA, cells (G01N21/6428 takes precedence)}
- G01N 2201/0668: Multiple paths; optimisable path length
- G01N 2201/12: Circuits of general importance; Signal processing
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)

## Abstract

An imager for simultaneously taking full color pictures and fluorescence images from the same perspectives, top-down and side views, is presented that uses multiple cameras looking at the same stage through a beamsplitter and light sources for each view. The imager is configured to work with a particular fluorophore, or at least a predetermined fluorescence excitation wavelength and emission wavelength. A broadband white light source projects through a shortpass or other filter with a cut-off wavelength either lower than or between the excitation and emission wavelengths. Another shortpass or other filter is in front of a color camera with a cut-off wavelength below that of the emission wavelength, while a monochrome fluorescence camera may or may not have additional filters to bring out the fluorescence. These filters may be built into a dichroic mirror of the beamsplitter. In addition, digital processing may boost frequencies in the color image that were dampened by the filters.

## Claims

### Claim 1

An imaging apparatus for resected tissue, the apparatus comprising:
a sample stage;
multiple dual-channel imaging assemblies, each dual-channel imaging assembly comprising:
a color camera having at least three different colored filter coatings over pixel sensors;
a fluorescence camera having a monochrome color coating or no color coating over pixel sensors;
a beamsplitter configured to reflect and transmit light from the sample stage to the cameras;
a white light source configured to illuminate the sample stage;
a fluorescence excitation light source aimed toward the sample stage, the fluorescence excitation light source having an excitation wavelength for stimulating fluorescence in a biocompatible dye at a predetermined emission wavelength;
a bandpass, notch, or shortpass optical filter over the white light source, the optical filter configured to block the emission wavelength, thereby inhibiting specular or diffuse reflections caused by the white light source at the emission wavelength.
wherein at least one of the dual-channel imaging assemblies is configured for a top-down view of the sample stage, and at least one of the dual-channel imaging assemblies is configured for a side view of the sample stage; and
a computer processor operatively connected with a machine-readable, non-transitory medium embodying information indicative of instructions for causing the computer processor to perform operations comprising:
taking a color picture with the color camera together with capturing a fluorescence image at the emission wavelength with the fluorescence camera in at least one of the dual-channel imaging assemblies; and
rendering the color picture and the fluorescence image for output to a display.

### Claim 2

(canceled)

### Claim 3 (depends on 1)

The apparatus of claim 1 wherein the operations further comprise:
boosting, in the color picture from at least one of the dual-channel imaging assemblies, colors that are otherwise blocked at the emission wavelength.

### Claim 4

An imaging apparatus for resected tissue, the apparatus comprising:
a sample stage;
multiple dual-channel imaging assemblies, each dual-channel imaging assembly comprising:
a color camera having at least three different colored filter coatings over pixel sensors;
a fluorescence camera having a monochrome color coating or no color coating over pixel sensors;
a beamsplitter configured to reflect and transmit light from the sample stage to the cameras;
a white light source configured to illuminate the sample stage;
a fluorescence excitation light source aimed toward the sample stage, the fluorescence excitation light source having an excitation wavelength for stimulating fluorescence in a biocompatible dye at a predetermined emission wavelength:
a notch, longpass, or shortpass optical filter over each color camera, the filter configured to block the excitation wavelength, thereby inhibiting saturation or artifacts caused by the fluorescence excitation light source at the excitation wavelength;
wherein at least one of the dual-channel imaging assemblies is configured for a top-down view of the sample stage, and at least one of the dual-channel imaging assemblies is configured for a side view of the sample stage; and
a computer processor operatively connected with a machine-readable, non-transitory medium embodying information indicative of instructions for causing the computer processor to perform operations comprising:
taking a color picture with the color camera together with capturing a fluorescence image at emission wavelength with the fluorescence camera in at least one of the dual-channel; imaging assemblies; and
rendering the color picture and the fluorescence image for output to a display.

### Claim 5 (depends on 4)

The apparatus of claim 4 wherein the operations further comprise:
boosting, in the color picture from at least one of the dual-channel imaging assemblies, colors that are otherwise blocked at the excitation wavelength.

### Claim 6 (depends on 5)

The apparatus of claim 5 wherein each dual-channel imaging assembly further comprises:
an unfiltered white light source,
wherein the operations further comprise:
taking a true color picture with the unfiltered white light source on while the fluorescence excitation light source is not irradiating; and
using the true color picture for the boosting.

### Claim 7 (depends on 1)

The apparatus of claim 1 wherein each beamsplitter incorporates a dichroic mirror that reflects or transmits light at the excitation wavelength away from, and reflects or transmits light at the emission wavelength to, the respective fluorescence camera.

### Claim 8 (depends on 7)

The apparatus of claim 7 wherein the dichroic mirror includes a bandpass, shortpass, or longpass mirror.

### Claim 9 (depends on 1)

The apparatus of claim 1 further comprising:
a bandpass, notch, or longpass optical filter in front of each fluorescence camera, the optical filter blocking light at the excitation wavelength.

### Claim 10 (depends on 1)

The apparatus of claim 1 wherein the sample stage is a rotatable sample stage having an axis of rotation.

### Claim 11 (depends on 10)

The apparatus of claim 10 further comprising:
a tilt bearing configured to rotate with the rotatable sample stage and tilt the sample stage, the tilt bearing having a tilt axis substantially orthogonal to the axis of rotation; and/or
a translation bearing configured to move the rotatable sample stage perpendicular to the axis of rotation.

### Claim 12 (depends on 10)

The apparatus of claim 10 wherein the color picture and the fluorescence image are part of real-time video streams being rendered to the display.

### Claim 13 (depends on 12)

The apparatus of claim 12 wherein the operations further comprise:
monitoring a rate of movement of a sample on the rotatable sample stage;
determining that the rate of movement has descending below a threshold rate;
sending, based on the determining, a trigger to the fluorescence cameras; and
lengthening an integration time of the fluorescence camera pixel sensors based on the trigger.

### Claim 14 (depends on 12)

The apparatus of claim 12 wherein the operations further comprise:
monitoring a rate of movement of a sample on the rotatable sample stage;
determining that the rate of movement has descending below a threshold rate; and
alternating, based on the determining, between taking color pictures while the white light source is illuminating and capturing fluorescence images while the fluorescence excitation light source is irradiating.

### Claim 15 (depends on 12)

The apparatus of claim 12 wherein the video streams are from the top-down dual-channel imaging assembly and the side view dual-channel imaging assembly; and
the video streams are rendered for user-switchable or simultaneous viewing on the display.

### Claim 16 (depends on 1)

The apparatus of claim 1 wherein the operations further comprise:
overlaying the color picture and the fluorescence image in a computer memory for the display.

### Claim 17 (depends on 1)

The apparatus of claim 1 wherein each color camera and fluorescence camera have a same number of pixel sensors.

### Claim 18 (depends on 1)

The apparatus of claim 1 wherein an angle between the top-down dual-channel imaging assembly and the side dual-channel imaging assembly is 90 degrees.

### Claim 19 (depends on 1)

The apparatus of claim 1 wherein the excitation wavelength is selected from the group consisting of 400 nanometers (nm), 633 nm to 636 nm, 647 nm, 649 nm, 651 nm, 660 nm, 680 nm, 740 nm, 780 nm, 810 nm, 830 nm, and 850 nm, and the emission wavelength is between about 600 nanometers (nm) and 950 nm.

### Claim 20 (depends on 1)

The apparatus of claim 1 wherein the fluorescence excitation light source includes a light emitting diode (LED) or a laser.

### Claim 21

A method of imaging resected tissue, the method comprising:
providing a sample stage;
providing multiple dual-channel imaging assemblies, each dual-channel imaging assembly comprising:
a color camera having at least three different colored filter coatings over pixel sensors;
a fluorescence camera having a monochrome color coating or no color coating over pixel sensors; and
a beamsplitter configured to reflect and transmit light from the sample stage to the cameras;
wherein at least one of the dual-channel imaging assemblies is configured for a top-down view of the sample stage, and at least one of the dual-channel imaging assemblies is configured for a side view of the sample stage;
illuminating a biological sample on the sample stage with a white light source;
irradiating the biological sample, together with the illuminating, with a fluorescence excitation light source at an excitation wavelength in order to stimulate fluorescence of a biocompatible dye within the biological sample at a predetermined emission wavelength, wherein the illuminating from the white light source is through a bandpass, notch, or shortpass optical filter that blocks the emission wavelength from the white light source, thereby inhibiting preventing specular or diffuse reflections caused by the white light source at the emission wavelength:
taking a color picture with the color camera together with capturing a fluorescence image at the emission wavelength with the fluorescence camera in at least one of the dual-channel imaging assemblies; and
rendering the color picture and the fluorescence image for output to a display.

### Claim 22

(canceled)

### Claim 23 (depends on 21)

The method of claim 21 wherein the sample stage is a rotatable sample stage having an axis of rotation.

### Claim 24 (depends on 23)

The method of claim 23 wherein the color picture and the fluorescence image are part of real-time video streams being rendered to the display, the method further comprising:
monitoring a rate of movement of the biological sample on the rotatable sample stage;
determining that the rate of movement has descending below a threshold rate;
sending, based on the determining, a trigger to the fluorescence cameras; and
lengthening an integration time of the fluorescence camera pixel sensors based on the trigger.

### Claim 25 (depends on 23)

The method of claim 23 wherein the color picture and the fluorescence image are part of real-time video streams being rendered to the display, the method further comprising:
monitoring a rate of movement of the biological sample on the rotatable sample stage;
determining that the rate of movement has descending below a threshold rate; and
alternating, based on the determining, between taking color pictures while the white light source is illuminating and capturing fluorescence images while the fluorescence excitation light source is irradiating.
