Computer scoring based on primary stain and immunohistochemistry images related application data

A system comprising:

• one or more data processors;
• and
• a non-transitory computer readable storage medium containing instructions which, when executed on the one or more data processors, cause the one or more data processors to perform operations comprising:
• receiving a first image and a second image, wherein the first image is a biomarker image and the second image is an H&E image;
• registering at least a portion of the first image to the second image to form a registered image;
• for the first image:
• detecting a set of nuclei;
• and
• computing, for a nucleus of the set of nuclei in the first image, one or more biomarker features of the nucleus;
• for the registered image:
• mapping one or more annotations of an image region the first image to a corresponding image region of the registered image to generate a mapped region of the registered image;
• and
• identifying, for the mapped region, one or more H&E features based at least in part on the one or more annotations;
• merging the one or more biomarker features of the nucleus detected from the first image and the one or more H&E features of the mapped region to generate one or more merged features corresponding to the nucleus of the first image;
• and
• classifying the nucleus of the first image based on the one or more merged features.

A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, including instructions configured to cause one or more data processors to perform operations comprising:

• receiving a first image and a second image, wherein the first image is a biomarker image and the second image is an H&E image;
• registering at least a portion of the first image to the second image to form a registered image;
• for the first image:
• detecting a set of nuclei;
• and
• computing, for a nucleus of the set of nuclei in the first image, one or more biomarker features of the nucleus;
• for the registered image:
• mapping one or more annotations of an image region the first image to a corresponding image region of the registered image to generate a mapped region of the registered image;
• and
• identifying, for the mapped region, one or more H&E features based at least in part on the one or more annotations;
• merging the one or more biomarker features of the nucleus detected from the first image and the one or more H&E features of the mapped region to generate one or more merged features corresponding to the nucleus of the first image;
• and
• classifying the nucleus of the first image based on the one or more merged features.