# US 2020/0401785 A1 · Systems and methods for identifying light emitting droplets using an image sensor and lens system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401785 A1
- Document ID: US20200401785A1
- Status: Published application
- Kind: A1
- Application number: 16/948,162
- Filed: 2020-09-04
- Published: 2020-12-24
- Earliest claimed: 2018-03-07
- Inventors: Christian Woehler
- Web page: https://patentgrep.com/patent/US20200401785A1

## CPC

- G01B 11/14: for measuring distance or clearance between spaced objects or spaced apertures (G01B11/26 takes precedence; rangefinders G01C3/00)
- G01B 11/002: {for measuring two or more coordinates}
- G01B 11/026: {by measuring distance between sensor and object (G01B11/0608 takes precedence)}
- G01B 11/22: for measuring depth
- G01N 15/1433: using image recognition
- G01N 21/6428: {Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" (in vivo A61B5/00; immunoassay G01N33/53)}
- G01N 21/6456: {Spatial resolved fluorescence measurements; Imaging}
- G02B 9/06: two + components
- G02B 13/22: Telecentric objectives or lens systems
- G02B 21/0008: {Microscopes having a simple construction, e.g. portable microscopes}
- G02B 21/361: {Optical details, e.g. image relay to the camera or image sensor (G02B21/364 takes precedence; illumination details G02B21/06 and subgroups)}
- G06T 7/50: Depth or shape recovery
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 20/693: {Acquisition}
- G16B 25/00: ICT specially adapted for hybridisation; ICT specially adapted for gene or protein expression
- G01N 2015/1445: {Three-dimensional imaging, imaging in different image planes, e.g. under different angles or at different depths, e.g. by a relative motion of sample and detector, for instance by tomography}
- G01N 2021/6439: {with indicators, stains, dyes, tags, labels, marks}
- G02B 21/06: Means for illuminating specimens
- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G16B: BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An apparatus for identifying a plurality of light emitting droplets includes a detector system having an image sensor comprising an array of pixels and a structure a structure associated with a surface of the image sensor that extends a height away from the surface of the image sensor and defines a field of view for pixels within the array of pixels. The apparatus can additionally include a lens system positioned in front of the image sensor that defines an object space and an image space for the image sensor such that light from a light emitting droplet located in the object space is recorded by a plurality of pixels within the array of pixels.

## Claims

### Claim 1

An apparatus for identifying a plurality of light emitting droplets, comprising:
a detector system comprising:
an image sensor comprising an array of pixels; and
a structure associated with a surface of the image sensor, the structure extending a height away from the surface of the image sensor and defining a field of view for pixels within the array of pixels; and
a lens system positioned in front of the image sensor and defining an object space of the detector system and an image space for the image sensor,
wherein light from a light emitting droplet that is located in the object space is in the field of view of a plurality of pixels within the array of pixels.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the lens system is configured to project a real image of the plurality of light emitting droplets in the object space, the real image being located within the image space of the lens system, and the image space being positioned in front of the image sensor.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the detector system is configured to monitor a presence of fluorescence within the plurality of light emitting droplets and to monitor an intensity of fluorescence emitted by the plurality of light emitting droplets, wherein the detector system monitors the fluorescence emitted by the plurality of light emitting droplets by taking a plurality of images in a given time period so that a movement of each one of the light emitting droplets is tracked and each one of the light emitting droplets is identifiable over the given time period.

### Claim 4 (depends on 1)

The apparatus of claim 1, further comprising a thermal cycler for cycling the plurality of light emitting droplets while the plurality of light emitting droplets is located in the object space.

### Claim 5 (depends on 1)

The apparatus of claim 1, further comprising a light source configured to illuminate the object space.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the apparatus comprises a plurality of detector systems and a plurality of object spaces, wherein each object space is monitored by at least one detector system.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the plurality of object spaces has a pitch of 9 mm or a multiple of 9 mm and a total number of object spaces is 96 or a divisor of 96 or wherein the plurality of object spaces has a pitch of 4.5 mm and the total number of object spaces is 384.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the lens system comprises a convergent lens system.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the lens system comprises a telecentric lens system.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the telecentric lens system comprises two or more convergent lens systems, each adjacent pair of convergent lens systems being spaced apart a distance equal to a sum of the focal lengths of each lens in each convergent lens system of the adjacent pair of convergent lens systems.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein each adjacent pair of convergent lens systems comprises:
a proximate convergent lens system; and
a distal convergent lens system,
wherein the proximate convergent lens system is positioned between the image sensor and the distal convergent lens system, and wherein the focal length of the proximate convergent lens system is less than or equal to the focal length of the distal convergent lens system, wherein an axial magnification of the adjacent pair of convergent lens systems increases the object space in a direction perpendicular to the image sensor.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein the object space is extended between 0.5 mm and 30 mm in a direction perpendicular to the image sensor.

### Claim 13 (depends on 1)

The apparatus of claim 1, wherein the image space is limited in a direction perpendicular to the surface of the image sensor to a range between 2 times the height of the structure and 1000 times the height of the structure and/or wherein the height of the structure is between 0.5 and 3 times the pixel pitch.

### Claim 14 (depends on 1)

The apparatus of claim 1, wherein the structure is associated with a surface of the image sensor and comprises a plurality of walls positioned on pixel boundaries, forming a regular grid, wherein the plurality of walls is formed around each pixel.

### Claim 15 (depends on 1)

A system for monitoring droplet polymerase chain reaction (PCR), comprising:
an apparatus as in claim 1;
an image processor configured to identify a number of light-emitting droplets within the plurality of droplets; and
a thermal cycler operably connected with the object space,
wherein the object space defined by the lens system of the apparatus comprises a plurality of droplets, a first subset of droplets of the plurality of droplets comprising PCR reagents, and a second subset of droplets of the plurality of droplets comprising a nucleic acid, and
wherein the detector system of the apparatus is positioned such that a real image of the plurality of droplets is imagable by the image sensor in the image space.

### Claim 16 (depends on 15)

The system of claim 15, wherein the image processor is additionally configured to count the number of light-emitting droplets, wherein counting the number of light-emitting droplets comprises capturing a light intensity value at each photoactivated pixel of the image sensor and identifying local maxima of light intensity based on the light intensity values.

### Claim 17 (depends on 16)

The system of claim 16, wherein counting the number of light-emitting droplets comprises:
capturing a light intensity value at each photoactivated pixel of the image sensor;
identifying a first light-emitting droplet, comprising identifying a local maximum of light intensity and a corresponding light profile associated with the local maximum;
subtracting the local maximum and the corresponding light profile from the captured light intensity values; and
identifying subsequent light-emitting droplets for each remaining local maximum and corresponding light profile,
wherein identifying the light profile for the light emitting droplet comprises:
calculating virtual light intensity values for the first photoactivated pixel and the one or more photoactivated pixels, wherein a virtual light intensity value for a pixel represents the amount of light received by the pixel from a virtual light emitting droplet, the virtual light emitting droplet having the same first photoactivated pixel as the light emitting droplet;
comparing the virtual light intensity values with the light intensity values determined for light emitting droplet; and
identifying the light profile for the light emitting droplet with the light profile for the virtual light emitting droplet in the case that the virtual light intensity values are fitting to the light intensity values for the light emitting droplet within a tolerance level.

### Claim 18 (depends on 17)

The system of claim 17, wherein the virtual light intensity value for the pixel is calculated based on a light receiving area of the pixel receiving light from the virtual light emitting droplet, wherein the virtual light intensity value for the pixel is calculated further based on a solid angle of the light receiving area of the pixel with respect to the virtual light emitting droplet.

### Claim 19

A method for identifying light-emitting droplets, comprising:
thermal cycling a sample vessel comprising a plurality of droplets, wherein the plurality of droplets comprises droplet PCR reagents and a nucleic-acid-binding fluorophore, and wherein at least a subset of the plurality of droplets comprise nucleic acid; and
monitoring the sample vessel using a detector system, the detector system comprising an image sensor with an array of pixels, a structure associated with a surface of the image sensor, the structure extending a height away from the surface of the image sensor and defining a field of view for pixels within the array of pixels, and a lens system positioned within the field of view and defining an object space of the detector system and an image space for the image sensor, wherein the sample vessel positions a sample within the object space of the detector system so that light from a light emitting droplet in the sample is in the field of view of a plurality of pixels within the array of pixels;
capturing a light intensity value at each photoactivated pixel of the image sensor receiving light from a real image of the sample vessel disposed in the image space; and
identifying a number of light-emitting droplets based on the light intensity values.

### Claim 20 (depends on 19)

The method as in claim 19, wherein identifying a number of light-emitting droplets comprises:
(i) determining a local maximum of light intensity and a corresponding light profile associated with the local maximum;
(ii) subtracting the corresponding light profile associated with the local maximum from the captured light intensity values; and
(iii) repeating steps (i) and (ii) for each subsequent local maximum and corresponding light profile.
