System and Method for Detection and Classification of Objects of Interest in Microscope Images by Supervised Machine Learning
AssigneeMetaSystems Hard and Software GmbH
InventorsAndreas PLESCH, Thomas LÖRCH
Life of this patent
Estimating the term…
Abstract
Methods are provided for efficient training of convoluted neural networks using computer-assisted microscope image acquisition and pre-classification of training images for biological objects of interest. The methods combine use of an automated scanning platform, on-the-fly image analysis parallel to the scanning process, and a user interface for review of the pre-classification performed by the software.
Claims24
A method for generating training images from microscope slides for use in optimizing a supervised machine learning model, the method comprising the steps of:
- (a) performing a pre-scan of a microscope slide containing a biological specimen using a first imaging modality;
- (b) extracting one or more specimen features from the pre-scan;
- (c) identifying from the extracted specimen features one or more slide positions that are likely to contain biological objects of interest;
- (d) acquiring targeted images using a second, different imaging modality at said one or more slide positions;
- (e) presenting the acquired targeted images for interactive classification of the biological objects of interest, wherein the classified acquired targeted images are suitable for use as training images for the supervised machine learning model.
The method of any of the preceding claims, wherein the identifying of step (c) and/or the classification of step (e) comprises the use of a convolutional neural network.
The method of any of the previous claims, wherein step (b) comprises applying a convolutional neural network.
The method of any of the previous claims, wherein step (b) comprises intensity thresholding followed by size and/or shape analysis.
The method of any of the previous claims, wherein step (b) comprises detection of a stain for a biomarker applied simultaneously with a brightfield stain.
A method for generation of training images from microscope slides for optimizing a supervised machine learning model, the method comprising the steps of:
- (a) performing a pre-scan of a microscope slide containing a biological specimen using a first imaging modality and/or first staining;
- (b) extracting one or more specimen features from the pre-scan;
- (c) repeating steps (a) and (b) using a second, different imaging modality and/or second staining of the biological specimen to obtain further extracted specimen features from the repeated scan;
- (d) using a convolutional neural network, the extracted specimen features of (b), and the further extracted specimen features of (c) to identify and/or classify biological objects of interest in the biological specimen;
- and optionally
- (e) presenting images of the biological objects of interest in a gallery for review and/or interactive correction of the classification;
- wherein the classified biological objects of interest are suitable for use as training images for the supervised machine learning model.
The method of any of the preceding claims, wherein the biological object of interest is a blood cell, an immune cell, a bacterium, or a parasite.
The method of any of the preceding claims, wherein the biological specimen comprises a bodily fluid or cell or tissue sample of a human or animal patient.
A system for the identification and/or classification of biological objects of interest on a microscope slide containing a specimen, the system comprising
- (a) an imaging microscope;
- (b) an automatic slide scanning device;
- (c) a computer programmed to perform the method of any of the preceding claims;
- and (d) a machine learning model stored in the computer that has been trained using the training images generated by any of the preceding claims to identify and/or classify the biological objects of interest.
A method for the identification and/or classification of biological objects of interest on a microscope slide, the method comprising the steps of:
- (a) performing a pre-scan of a microscope slide using a first imaging modality and/or staining;
- (b) extracting one or more specimen features from the pre-scan;
- (c) identifying from the extracted specimen features one or more slide positions that are likely to contain biological objects of interest;
- (d) acquiring targeted images using a second, different imaging modality and/or staining at said one or more slide positions;
- and
- (e) using a machine learning model (CNN) to identify and/or classify biological objects of interest in the biological specimen;
- and optionally
- (f) presenting images of the biological objects of interest identified in (e) for review.
Dependencies are inferred from the claim text.