US 2022/0189150 A1 · SYSTEMS AND METHODS FOR GENERATING HISTOLOGY IMAGE TRAINING DATASETS FOR MACHINE LEARNING MODELS

Abstract

A system and method are provided for training and using a machine learning model to analyze hematoxylin and eosin (H&E) slide images, where the machine learning model is trained using a training data set comprising a plurality of unmarked H&E images and a plurality of marked H&E images, each marked H&E image being associated with one unmarked H&E image and each marked H&E image including a location of one or more molecules determined by analyzing a multiplex IHC image having at least two IHC stains, each IHC stain having a unique color and a unique target molecule. Predicted molecules and locations identified with the machine learning model result in an immunotherapy response class being assigned to the H&E slide image.

Claims43

Dependent claims

A method for using a machine learning model to analyze at least one hematoxylin and eosin (H&E) slide image, the method comprising:

a. receiving, at one or more processors, the H&E slide image;
b. using, at the one or more processors, a machine learning model to predict locations of molecules in the H&E slide image, where the machine learning model is trained using a training data set comprising a plurality of unmarked H&E images and a plurality of marked H&E images, each marked H&E image being associated with one unmarked H&E image and each marked H&E image including a location of one or more molecules determined by analyzing a multiplex IHC image having at least two IHC stains, wherein each IHC stain has a unique color and a unique target molecule and wherein analyzing the multiplex IHC image includes determining an IHC stain that contributes to any two or more overlapping or adjacent IHC stains and comparing each IHC stain in the multiplex IHC image to a threshold;
c. analyzing the number of predicted molecules and locations of the predicted molecules;
and
d. assigning an immunotherapy response class to the H&E slide image, based on the number of predicted molecules and/or locations of the predicted molecules.

2 more elements

Dependencies are inferred from the claim text.

Systems and methods for generating histology image training datasets for machine learning models

Life of this patent

Systems and methods for generating histology image training datasets for machine learning models

Life of this patent

Abstract

Claims43