# US 2022/0092339 A1 · Apparatus for classifying medical image

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0092339 A1
- Document ID: US20220092339A1
- Status: Published application
- Kind: A1
- Application number: 17/393,656
- Filed: 2021-08-04
- Published: 2022-03-24
- Earliest claimed: 2020-09-23
- Assignees: Vingroup Joint Stock Company
- Applicants: Vingroup Joint Stock Company
- Inventors: Quan M. Tran; Huy D. Ta; Thanh M. Huynh; Nam H. Nguyen; Phuong-Anh T. Nguyen; Steven QH. Truong
- Web page: https://patentgrep.com/patent/US20220092339A1

## CPC

- G06F 18/2431: Multiple classes
- G16H 30/40: for processing medical images, e.g. editing
- G06F 18/2132: based on discrimination criteria, e.g. discriminant analysis
- G06T 7/0012: {Biomedical image inspection}
- G06V 10/82: using neural networks
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- G06T 2207/10116: X-ray image
- G06T 2207/20076: Probabilistic image processing
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30061: Lung
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Provided is an apparatus for classifying a medical image. The apparatus includes a database configured to store a first image, a generator configured to generate a second image on the basis of a latent vector which is a concatenation of noise information having a certain size and random uniform class labels of a plurality of diseases, a discriminator configured to receive the first image and the second image and attempt to recognize the first image and the second image as a real image and a fake image, and a classifier configured to classify the first image and the second image.

## Claims

### Claim 1

An apparatus for classifying a medical image, the apparatus comprising:
a database configured to store a first image;
a generator configured to generate a second image on the basis of a latent vector which is a concatenation of noise information having a certain size and random uniform class labels of a plurality of diseases;
a discriminator configured to receive the first image and the second image and attempt to recognize the first image and the second image as a real image and a fake image; and
a classifier configured to classify the first image and the second image.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the noise information has a size of 16 dimensions and is generated on the basis of a normal distribution.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the random uniform class labels of the plurality of diseases are random uniform class labels of coronavirus disease 2019 (COVID-19), airspace opacity, consolidation, and pneumonia and have a value of 0 for negative cases of the diseases and a value of 1 for positive cases of the diseases.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the discriminator calculates a probability distribution with relation to the second image.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the generator and the discriminator are implemented as progressive growing generative adversarial networks (GANs).

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the classifier is implemented as DenseNet121.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein in the classifier, the number of output neurons is set differently depending on a classification type.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the classifier sets the number of output neurons to 1 when the classification type is a binary label classification and set the number of output neurons to 4 when the classification type is a multi-label classification.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein all of the activations of the classifier and the discriminator are replaced by Leaky ReLU.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the classifier sets a leaky coefficient to 0.02.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein a final layer of the classifier uses a logistic sigmoid function.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein the generator, the discriminator, and the classifier are trained on the basis of the following formula:
min
θ
G
,
θ
C
⁢
max
θ
D
⁢
L
⁡
(
C
)
+
λ
⁡
(
V
⁡
(
G
,
D
)
+
L
⁡
(
G
,
C
)
)
.
where L(C) denotes a classification loss, V(G, D) denotes an adversarial loss, L(G, C) denotes a classification-driven generative loss, and λ denotes a hyperparameter.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the hyperparameter is 0.1.

### Claim 14 (depends on 12)

The apparatus of claim 12, wherein the hyperparameter is 1 when optimizing discriminator and generator.

### Claim 15 (depends on 1)

The apparatus of claim 1, further comprising a diagnostic unit configured to make a disease diagnosis from an image of a patient on the basis of the classified first image and second image.
