# US 2022/0284604 A1 · Multispectral microscope system and method for registering first and second images by means thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0284604 A1 - Document ID: US20220284604A1 - Status: Published application - Kind: A1 - Application number: 17/676,318 - Filed: 2022-02-21 - Published: 2022-09-08 - Earliest claimed: 2021-03-05 - Assignees: Leica Microsystems CMS GmbH - Applicants: Leica Microsystems CMS GmbH - Inventors: Christian SCHUMANN; Kai RITSCHEL; Mate BELJAN - Web page: https://patentgrep.com/patent/US20220284604A1 ## CPC - G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration - G06T 7/32: using correlation-based methods - G02B 21/16: adapted for ultraviolet illumination {; Fluorescence microscopes (G02B21/0076 takes precedence)} - G02B 21/365: {Control or image processing arrangements for digital or video microscopes (G02B21/361, G02B21/362 take precedence)} - G06T 5/80: Geometric correction - G06T 2207/10056: Microscopic image - G06T 2207/10064: Fluorescence image - G06T 2207/20212: Image combination - G06T 2207/30108: Industrial image inspection - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract A multispectral microscope system includes: a first detector element for capturing a first image of a sample in a first spectral channel; at least a second detector element for capturing a second image of the sample in a second spectral channel; and a processor for determining a spatial correlation between the first and second images based on a spectral crosstalk between the first and second spectral channels and registering the first and second images based on the spatial correlation. ## Claims ### Claim 1 A multispectral microscope system, comprising: a first detector element configured to capture a first image of a sample in a first spectral channel; at least a second detector element configured to capture a second image of the sample in a second spectral channel; and a processor configured to determine a spatial correlation between the first and second images based on a spectral crosstalk between the first and second spectral channels and to register the first and second images based on the spatial correlation. ### Claim 2 (depends on 1) The microscope system of claim 1, wherein the spatial correlation comprises a mutual information or a cross correlation, comprising a phase correlation, between the first and second images. ### Claim 3 (depends on 1) The microscope system of claim 1, wherein the processor is configured to determine at least one transformation parameter based on the spatial correlation in order to register the first and second images. ### Claim 4 (depends on 1) The microscope system of claim 1, wherein the processor is configured to perform a coarse image registration of the first and second images based on a predetermined transformation in order to generate coarsely registered first and second images, and to determine the spatial correlation based on the coarsely registered first and second images. ### Claim 5 (depends on 1) The microscope system of claim 1, wherein the processor is configured to perform the determination of the spatial correlation and the registration of the first and second images according to a predetermined time schedule. ### Claim 6 (depends on 1) The microscope system of claim 1, further comprising: at least one sensor element, wherein the processor is configured to perform the determination of the spatial correlation and the registration of the first and second images according to a sensor input from the at least one sensor element. ### Claim 7 (depends on 6) The microscope system of claim 6, wherein the at least one sensor element comprises a temperature sensor. ### Claim 8 (depends on 1) The microscope system of claim 1, wherein the multispectral microscope system comprises a fluorescence microscope system. ### Claim 9 (depends on 1) The microscope system of claim 1, wherein the processor is configured to perform spectral unmixing on the registered first and second images. ### Claim 10 (depends on 1) The microscope system of claim 1, wherein the processor is configured to correct a first optical distortion in the first image in order to generate a first distortion corrected image, to correct a second optical distortion in the second image in order to generate a second distortion corrected image, and to determine the spatial correlation based on the first and second distortion corrected images. ### Claim 11 (depends on 10) The microscope system of claim 10, wherein the processor is configured to correct the first and second optical distortion based on at least one predetermined optical parameter of the microscope system. ### Claim 12 (depends on 1) The microscope system according claim 1, wherein the processor is configured to determine an image quality of the first and second images based on the spatial correlation. ### Claim 13 (depends on 1) The microscope system of claim 1, further comprising: a beam splitter arrangement configured to direct first light having a first wavelength spectrum onto the first detector element in order to define the first spectral channel, and to direct second light having a second wavelength spectrum onto the second detector element in order to define the second spectral channel. ### Claim 14 (depends on 1) The microscope system of claim 1, further comprising: a mechanical connection element mechanically connecting the first and second detector elements. ### Claim 15 A method for registering first and second images by a multispectral microscope, comprising: capturing a first image of a sample in a first spectral channel; capturing a second image of the sample in a second spectral channel; determining a spatial correlation between the first and second images based on a spectral crosstalk between the first and second spectral channels; and registering the first and second images based on the spatial correlation.