# US 2024/0266035 A1 · Automatic assay assessment and normalization for image processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0266035 A1
- Document ID: US20240266035A1
- Status: Published application
- Kind: A1
- Application number: 18/625,118
- Filed: 2024-04-02
- Published: 2024-08-08
- Earliest claimed: 2017-08-04
- Assignees: Ventana Medical Systems, Inc.
- Applicants: Ventana Medical Systems, Inc.
- Inventors: Yao Nie; Maria V. Sainz De Cea
- Web page: https://patentgrep.com/patent/US20240266035A1

## CPC

- G16H 30/40: for processing medical images, e.g. editing
- G01N 15/1433: using image recognition
- G06F 16/535: Filtering based on additional data, e.g. user or group profiles
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 7/90: Determination of colour characteristics
- G06V 20/698: {Matching; Classification}
- G16H 10/40: for data related to laboratory analysis, e.g. patient specimen analysis
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 70/60: relating to pathologies
- G01N 2015/1006: {for cytology}
- G06T 2207/10024: Color image
- G06T 2207/10056: Microscopic image
- G06T 2207/30024: Cell structures in vitro; Tissue sections in vitro
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Disclosed herein are systems and methods for of assessing stain titer levels. An exemplary method includes generating a set of field of views for the image or the region of the image, selecting field of views from the set of field of views that meet predefined criteria, creating a series of patches within each of the selected field of views, retaining patches from the series of patches that meet predefined criteria indicative of a presence of the stain for which the titer is to be estimated, deriving stain color features and stain intensity features pertaining to the stain from the retained patches, estimating a titer score for each of the retained patches based on the stain color features and the stain intensity features, and calculating a weighted average score for the titer of the stain based on the estimated titer score for each of the retained patches.

## Claims

### Claim 1

A method comprising:
determining an estimated titer level of a query image, the query image being an image of a biological sample stained with a stain, wherein the estimated titer level of the query image is determined in-part by classifying stain image features derived from image patches of the query image; and
normalizing a titer level of the query image, wherein the titer level of the query image is normalized by:
deriving chromatic distribution coordinates and density distribution coordinates in the query image within a color model which incorporates density information;
aligning, based in-part on a first parameter value associated with the estimated titer level of the query image, the chromatic distributions coordinates in the query image with template image chromatic distribution coordinates to provide transformed chromatic distribution coordinates;
scaling, based in-part on a second parameter value associated with the estimate titer level of the query image, the density distribution coordinates in the query image with template image density distribution coordinates to provide transformed density distribution coordinates; and
reconstructing an RGB image by inversely transforming the query image within the color model incorporating the density information using weighted transformed chromatic distribution coordinates and weighted transformed density distribution coordinates.

### Claim 2 (depends on 1)

The method of claim 1, wherein the image patches are derived by:
extracting a predefined number of FOVs from the query image;
computing a set of patches for each FOV of the FOVs; and
retaining those patches from the set of patches for each FOV of the FOVs that meet threshold patch criteria.

### Claim 3 (depends on 1)

The method of claim 1, wherein the determining the estimated titer level of the query image occurs prior to the normalizing the titer level of the query image.

### Claim 4 (depends on 1)

The method of claim 1, wherein the determining the estimated titer level of the query image occurs during the normalizing the titer level of the query image.

### Claim 5 (depends on 1)

The method of claim 1, wherein the weighted transformed chromatic distribution coordinates and the weighted transformed density distribution coordinates are derived by:
computing probabilities that pixels are stain pixels; and
weighting the transformed chromatic distribution coordinates and the transformed density distribution coordinates with the probabilities.

### Claim 6 (depends on 1)

The method of claim 1, wherein aligning the chromatic distributions coordinates comprises shifting and rotating the chromatic distribution coordinates in the query image to have a same mean and orientation as the template image chromatic distribution coordinates.

### Claim 7 (depends on 1)

The method of claim 1, wherein the scaling the density distribution coordinates comprises transforming the density distribution coordinates to have a same weighted mean and weighted standard deviation as the template image density distribution coordinates.

### Claim 8

A system comprising:
one or more processors; and
one or more memories coupled to the one or more processors, the one or more memories to store computer-executable instructions that, when executed by the one or more processors, cause the system to perform operations comprising:
determining an estimated titer level of a query image, the query image being an image of a biological sample stained with a stain, wherein the estimated titer level of the query image is determined in-part by classifying stain image features derived from image patches of the query image; and
normalizing a titer level of the query image, wherein the titer level of the query image is normalized by:
deriving chromatic distribution coordinates and density distribution coordinates in the query image within a color model which incorporates density information;
aligning, based in-part on a first parameter value associated with the estimated titer level of the query image, the chromatic distributions coordinates in the query image with template image chromatic distribution coordinates to provide transformed chromatic distribution coordinates;
scaling, based in-part on a second parameter value associated with the estimate titer level of the query image, the density distribution coordinates in the query image with template image density distribution coordinates to provide transformed density distribution coordinates; and
reconstructing an RGB image by inversely transforming the query image within the color model incorporating the density information using weighted transformed chromatic distribution coordinates and weighted transformed density distribution coordinates.

### Claim 9 (depends on 8)

The system of claim 8, wherein the image patches are derived by:
extracting a predefined number of FOVs from the query image;
computing a set of patches for each FOV of the FOVs; and
retaining those patches from the set of patches for each FOV of the FOVs that meet threshold patch criteria.

### Claim 10 (depends on 8)

The system of claim 8, wherein the determining the estimated titer level of the query image occurs prior to the normalizing the titer level of the query image.

### Claim 11 (depends on 8)

The system of claim 8, wherein the determining the estimated titer level of the query image occurs during the normalizing the titer level of the query image.

### Claim 12 (depends on 8)

The system of claim 8, wherein the weighted transformed chromatic distribution coordinates and the weighted transformed density distribution coordinates are derived by:
computing probabilities that pixels are stain pixels; and
weighting the transformed chromatic distribution coordinates and the transformed density distribution coordinates with the probabilities.

### Claim 13 (depends on 8)

The system of claim 8, wherein aligning the chromatic distributions coordinates comprises shifting and rotating the chromatic distribution coordinates in the query image to have a same mean and orientation as the template image chromatic distribution coordinates.

### Claim 14 (depends on 8)

The system of claim 8, wherein the scaling the density distribution coordinates comprises transforming the density distribution coordinates to have a same weighted mean and weighted standard deviation as the template image density distribution coordinates.

### Claim 15

A non-transitory computer-readable medium storing instructions which, when executed by one or more processors, cause a system to perform operations comprising:
determining an estimated titer level of a query image, the query image being an image of a biological sample stained with a stain, wherein the estimated titer level of the query image is determined in-part by classifying stain image features derived from image patches of the query image; and
normalizing a titer level of the query image, wherein the titer level of the query image is normalized by:
deriving chromatic distribution coordinates and density distribution coordinates in the query image within a color model which incorporates density information;
aligning, based in-part on a first parameter value associated with the estimated titer level of the query image, the chromatic distributions coordinates in the query image with template image chromatic distribution coordinates to provide transformed chromatic distribution coordinates;
scaling, based in-part on a second parameter value associated with the estimate titer level of the query image, the density distribution coordinates in the query image with template image density distribution coordinates to provide transformed density distribution coordinates; and
reconstructing an RGB image by inversely transforming the query image within the color model incorporating the density information using weighted transformed chromatic distribution coordinates and weighted transformed density distribution coordinates.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the image patches are derived by:
extracting a predefined number of FOVs from the query image;
computing a set of patches for each FOV of the FOVs; and
retaining those patches from the set of patches for each FOV of the FOVs that meet threshold patch criteria.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the determining the estimated titer level of the query image occurs prior to the normalizing the titer level of the query image.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the determining the estimated titer level of the query image occurs during the normalizing the titer level of the query image.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the weighted transformed chromatic distribution coordinates and the weighted transformed density distribution coordinates are derived by:
computing probabilities that pixels are stain pixels; and
weighting the transformed chromatic distribution coordinates and the transformed density distribution coordinates with the probabilities.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein aligning the chromatic distributions coordinates comprises shifting and rotating the chromatic distribution coordinates in the query image to have a same mean and orientation as the template image chromatic distribution coordinates, and wherein the scaling the density distribution coordinates comprises transforming the density distribution coordinates to have a same weighted mean and weighted standard deviation as the template image density distribution coordinates.
