Fusion of molecular chemical imaging with RGB imaging
AssigneeChemImage Corporation
InventorsHeather Gomer, Patrick Treado, Jihang Wang
Life of this patent
Estimating the term…
Abstract
Methods, systems, and computer program products of fusing Molecular Chemical Imaging (MCI) and Red Green Blue (RGB) images are disclosed herein. A sample is illuminated with illuminating photons which interact with the sample and are used to form MCI and RGB images. The MCI and RGB images are fused by way of mathematical operations to generate a RGB image with a detection overlay.
Claims24
A method of fusing images, the method comprising:
- illuminating a sample with illuminating photons;
- obtaining a first sample image from interacted photons that have interacted with the sample and have traveled to a first camera chip;
- obtaining a second sample image from interacted photons that have interacted with the sample and have traveled to a second camera chip;
- and
- fusing the first sample image and the second sample image by weighting the first sample image and the second sample image, wherein the weighting of the first sample image and the second sample image is performed by one or more of Image Weighted Bayesian Fusion (IWBF), Partial Least Squares Discriminant Analysis (PLS-DA), linear regression, logistic regression, Support Vector Machines (SVM), Relative Vector Machines (RVM), Naïve Bayes, or Linear Discriminant Analysis (LDA), to thereby generate a fused score image,
- wherein the second sample image is a molecular chemical image, and
- wherein the second sample image is obtained by a dual polarization device.
A system for fusing images, the system comprising:
- an illumination source configured to illuminate a sample with illuminating photons;
- a first camera chip configured to obtain a first sample image from interacted photons that have interacted with the sample;
- a second camera chip configured to obtain a second sample image from interacted photons that have interacted with the sample;
- and
- a processor that during operation fuses the first sample image and the second sample image by weighting the first sample image and the second sample image, wherein the weighting of the first sample image and the second sample image is performed by one or more of Image Weighted Bayesian Fusion (IWBF), Partial Least Squares Discriminant Analysis (PLS-DA), linear regression, logistic regression, Support Vector Machines (SVM), Relative Vector Machines (RVM), Naïve Bayes, or Linear Discriminant Analysis (LDA) to thereby generate a fused score image,
- wherein the second sample image is a molecular chemical image, and
- wherein the second sample image is obtained by a dual polarization device.
A computer program product for fusing images embodied by instructions on a non-transitory computer readable storage medium, which when the instructions are executed by a processor causes:
- an illumination source to illuminate a sample with illuminating photons;
- a first camera chip to obtain a first sample image from interacted photons that have interacted with the sample;
- a second camera chip to obtain a second sample image from interacted photons that have interacted with the sample;
- and
- the processor to fuse the first sample image and the second sample image by weighting the first sample image and the second sample image, wherein the weighting of the first sample image and the second sample image is performed by one or more of Image Weighted Bayesian Fusion (IWBF), Partial Least Squares Discriminant Analysis (PLS-DA), linear regression, logistic regression, Support Vector Machines (SVM), Relative Vector Machines (RVM), Naïve Bayes, or Linear Discriminant Analysis (LDA) to thereby generate a fused score image,
- wherein the second sample image is a molecular chemical image, and
- wherein the second sample image is obtained by a dual polarization device.
Dependencies are inferred from the claim text.