Systems and methods for processing electronic images for biomarker localization

A system for analyzing an image corresponding to a specimen, the system comprising:

• at least one memory storing instructions;
• and
• at least one processor configured to execute the instructions to perform operations comprising:
• receiving one or more digital images of a pathology specimen from a patient, the pathology specimen comprising tumor tissue, the one or more digital images being associated with data about a plurality of biomarkers in the tumor tissue and data about a surrounding invasive margin around the tumor tissue;
• identifying the tumor tissue and the surrounding invasive margin region to be analyzed for each of the one or more digital images;
• generating, using a machine learning model on the one or more digital images, at least one inference of a presence of the plurality of biomarkers in the tumor tissue and the surrounding invasive margin region;
• determining a spatial relationship of each of the plurality of biomarkers identified in the tumor tissue and the surrounding invasive margin region to themselves and to other cell types;
• and
• determining, based on the spatial relationship of each of the plurality of biomarkers to themselves and to other cell types, a prediction for a treatment outcome and/or at least one treatment recommendation for the patient.

A non-transitory computer readable medium storing instructions that, when executed by a processor, cause the processor to perform a method for analyzing an image corresponding to a specimen, the method comprising:

• receiving one or more digital images of a pathology specimen from a patient, the pathology specimen comprising tumor tissue, the one or more digital images being associated with data about a plurality of biomarkers in the tumor tissue and data about a surrounding invasive margin around the tumor tissue;
• identifying the tumor tissue and the surrounding invasive margin region to be analyzed for each of the one or more digital images;
• generating, using a machine learning model on the one or more digital images, at least one inference of a presence of the plurality of biomarkers in the tumor tissue and the surrounding invasive margin region;
• determining a spatial relationship of each of the plurality of biomarkers identified in the tumor tissue and the surrounding invasive margin region to themselves and to other cell types;
• and
• determining, based on the spatial relationship of each of the plurality of biomarkers to themselves and to other cell types, a prediction for a treatment outcome and/or at least one treatment recommendation for the patient.