# US 2021/0333298 A1 · Hypothesizing and verification networks and methods for specimen classification

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0333298 A1
- Document ID: US20210333298A1
- Status: Published application
- Kind: A1
- Application number: 17/278,289
- Filed: 2019-09-19
- Published: 2021-10-28
- Earliest claimed: 2018-09-20
- Assignees: Siemens Healthcare Diagnostics Inc.
- Applicants: Siemens Healthcare Diagnostics Inc.
- Inventors: Venkatesh NarasimhaMurthy; Vivek Singh; Yao-Jen Chang; Benjamin S. Pollack; Ankur Kapoor
- Web page: https://patentgrep.com/patent/US20210333298A1

## CPC

- G01N 35/00732: {Identification of carriers, materials or components in automatic analysers}
- G06F 18/2413: based on distances to training or reference patterns
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06T 7/0012: {Biomedical image inspection}
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/82: using neural networks
- G06V 20/698: {Matching; Classification}
- G01N 2035/00752: {bar codes}
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30024: Cell structures in vitro; Tissue sections in vitro
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method of characterizing a specimen as containing hemolysis, icterus, or lipemia is provided. The method includes capturing one or more images of the specimen, wherein the one or more images include a serum or plasma portion of the specimen. Pixel data is generated by capturing the image. The pixel data of the one or more images of the specimen is processed using a first network executing on a computer to predict a classification of the serum or plasma portion, wherein the classification comprises hemolysis, icterus, and lipemia. The predicted classification is verified using one or more verification networks. Quality check modules and specimen testing apparatus adapted to carry out the method are described, as are other aspects.

## Claims

### Claim 1

A method of characterizing a specimen, comprising:
capturing one or more images of the specimen, the one or more images including a serum or plasma portion of the specimen, the capturing generating pixel data;
processing pixel data of the one or more images of the specimen using a first network executing on a computer to predict a classification of the serum or plasma portion, wherein the classification comprises hemolysis, icterus, and lipemia; and
verifying the predicted classification using one or more verification networks.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
verifying the predicted classification by a verification network trained on hemolysis in response to the first network predicting a hemolysis classification of the specimen;
verifying the predicted classification by a verification network trained on icterus in response to the first network predicting an icterus classification of the specimen; and
verifying the predicted classification by a verification network trained on lipemia in response to the first network predicting a lipemia classification of the specimen.

### Claim 3 (depends on 1)

The method of claim 1, wherein:
processing pixel data comprises predicting a classification index for at least one of hemolysis, icterus, and lipemia; and
verifying the predicted classification comprises verifying the predicted classification index using one or more index verification networks trained on the predicted classification index.

### Claim 4 (depends on 1)

The method of claim 1, wherein:
processing pixel data comprises predicting a hemolysis classification index; and
verifying the predicted classification comprises verifying the predicted hemolysis classification index using an index verification network trained on the predicted hemolysis classification index.

### Claim 5 (depends on 1)

The method of claim 1, wherein:
processing pixel data comprises predicting an icterus classification index; and
verifying the predicted classification comprises verifying the predicted icterus classification index using an index verification network trained on the predicted icterus classification index.

### Claim 6 (depends on 1)

The method of claim 1, wherein:
processing pixel data comprises predicting a lipemia classification index; and
verifying the predicted classification comprises verifying the predicted lipemia classification index using an index verification network trained on the predicted lipemia classification index.

### Claim 7 (depends on 1)

The method of claim 1, wherein the classification further comprises a normal classification.

### Claim 8 (depends on 7)

The method of claim 7, further comprising verifying the normal classification using a verification network trained on a normal classification.

### Claim 9 (depends on 1)

The method of claim 1, wherein processing pixel data of the one or more images of the specimen using a first network comprises processing pixel data of the one or more images of the specimen using a segmentation network.

### Claim 10 (depends on 1)

The method of claim 1, wherein processing pixel data of the one or more images of the specimen using a first network comprises processing pixel data of the one or more images of the specimen using a classification network.

### Claim 11 (depends on 1)

The method of claim 1, wherein processing pixel data comprises:
identifying a serum or plasma portion in the specimen using a deep semantic segmentation network; and
predicting a classification index of the serum or plasma portion of the specimen using the deep semantic segmentation network based at least partially on color represented by the pixel data of the serum or plasma portion.

### Claim 12 (depends on 1)

The method of claim 1, wherein the first network comprises an architecture including at least eleven dense block layers.

### Claim 13 (depends on 1)

The method of claim 1, further comprising generating a confidence level in response to verifying the predicted classification using the one or more verification networks.

### Claim 14 (depends on 1)

The method of claim 1, further comprising generating a confidence level in response to verifying the predicted classification using one or more verification networks and generating a signal in response to the confidence level being below a predetermined level.

### Claim 15 (depends on 1)

The method of claim 1, wherein the one or more verification networks comprise one or more convolutional neural networks.

### Claim 16

A quality check module, comprising:
a plurality of image capture devices operative to capture one or more images from one or more viewpoints of a specimen container containing a serum or plasma portion of a specimen therein; and
a computer coupled to the plurality of image capture devices, the computer configured and operative to:
capture one or more images of the specimen, the one or more images including a serum or plasma portion of the specimen, the capture generating pixel data;
process pixel data of the one or more images of the specimen using a first network executing on the computer to predict a classification of the serum or plasma portion, wherein the classification comprises hemolysis, icterus, and lipemia; and
verifying the predicted classification using one or more verification networks executing on the computer.

### Claim 17 (depends on 16)

The quality check module of claim 16, wherein the computer is further configured and operative to process pixel data to predict a normal classification of the serum or plasma portion.

### Claim 18 (depends on 16)

The quality check module of claim 16, wherein the computer is configured and operative to:
process pixel data to predict a classification index; and
verify the predicted classification index using one or more verification networks trained on the predicted classification index.

### Claim 19 (depends on 16)

The quality check module of claim 16, wherein the computer is configured and operative to:
verify the predicted classification by a verification network trained on hemolysis in response to the first network predicting a hemolysis classification for the specimen;
verify the predicted classification by a verification network trained on icterus in response to the first network predicting an icterus classification for the specimen; and
verify the predicted classification by a verification network trained on lipemia in response to the first network predicting a lipemia classification for the specimen.

### Claim 20 (depends on 16)

The quality check module of claim 16, wherein the one or more verification networks comprise one or more convolutional neural networks.

### Claim 21

A specimen testing apparatus, comprising:
a track;
a carrier moveable on the track and configured to contain a specimen container containing a serum or plasma portion of a specimen therein;
a plurality of image capture devices arranged around the track and operative to capture one or more images from one or more viewpoints of the specimen container and the serum or plasma portion of the specimen; and
a computer coupled to the plurality of image capture devices, the computer configured and operative to:
capture one or more images of the specimen, the one or more images including a serum or plasma portion of the specimen, the capture generating pixel data;
process pixel data of the one or more images of the specimen using a first network executing on the computer to predict a classification of the serum or plasma portion, wherein the classification comprises hemolysis, icterus, and lipemia; and
verify the predicted classification using one or more verification networks executing on the computer.
