# US 2023/0414204 A1 · Ultrasound diagnostic apparatus and control method of ultrasound diagnostic apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0414204 A1
- Document ID: US20230414204A1
- Status: Published application
- Kind: A1
- Application number: 18/325,495
- Filed: 2023-05-30
- Published: 2023-12-28
- Earliest claimed: 2022-06-22
- Assignees: FUJIFILM Corporation
- Applicants: FUJIFILM Corporation
- Inventors: Riko KOSHINO; Takuya TSUTAOKA
- Web page: https://patentgrep.com/patent/US20230414204A1

## CPC

- A61B 8/54: {Control of the diagnostic device}
- A61B 8/085: {for locating body or organic structures, e.g. tumours, calculi, blood vessels, nodules}
- A61B 8/463: {characterised by displaying multiple images or images and diagnostic data on one display}
- A61B 8/5223: {for extracting a diagnostic or physiological parameter from medical diagnostic data (for algorithms to analyse biomedical images G06T7/0012)}
- G06T 7/0014: {using an image reference approach}
- G06T 7/12: Edge-based segmentation
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/82: using neural networks
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- A61B 8/0825: {for diagnosis of the breast, e.g. mammography}
- A61B 8/467: {characterised by special input means}
- A61B 8/5246: {combining images from the same or different imaging techniques, e.g. color Doppler and B-mode}
- G06T 2207/10132: Ultrasound image
- G06T 2207/20081: Training; Learning
- G06T 2207/30096: Tumor; Lesion
- G06T 2207/30132: Masonry; Concrete
- G06T 2210/12: Bounding box
- G06V 2201/031: of internal organs
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

There are provided an ultrasound diagnostic apparatus and a control method of the ultrasound diagnostic apparatus which allow a user to accurately perform a diagnosis for a lesion part. The ultrasound diagnostic apparatus includes an image feature calculation unit that calculates a multidimensional image feature in each of a plurality of ultrasound images in which a lesion part of a subject is imaged, by analyzing the plurality of ultrasound images; a score calculation unit that calculates a score of the lesion part in each of the plurality of ultrasound images on the basis of the multidimensional image feature; a determination unit that performs determination on the lesion part on the basis of the score calculated for each of the plurality of ultrasound images; an extraction unit that extracts the ultrasound image best representing a determination result of the determination unit from the plurality of ultrasound images, as a basis image; a monitor; and a display controller that displays the determination result of the determination unit and the basis image extracted by the extraction unit on the monitor.

## Claims

### Claim 1

An ultrasound diagnostic apparatus that performs determination on a lesion part of a subject based on a plurality of ultrasound images in which the lesion part is imaged, the ultrasound diagnostic apparatus comprising:
a monitor;
a processor configured to
calculate a multidimensional image feature in each of the plurality of ultrasound images by analyzing the plurality of ultrasound images,
calculate a score of the lesion part in each of the plurality of ultrasound images based on the multidimensional image feature,
perform determination on the lesion part based on the score calculated for each of the plurality of ultrasound images,
extract the ultrasound image best representing a determination result on the lesion part from the plurality of ultrasound images, as a basis image, and
display the determination result of the determination unit and the basis image on the monitor.

### Claim 2 (depends on 1)

The ultrasound diagnostic apparatus according to claim 1,
wherein the plurality of ultrasound images are images forming a video in which the lesion part is imaged.

### Claim 3 (depends on 1)

The ultrasound diagnostic apparatus according to claim 1,
wherein each of the plurality of ultrasound images is an image in which an entire or a part of the lesion part is imaged.

### Claim 4 (depends on 2)

The ultrasound diagnostic apparatus according to claim 2,
wherein each of the plurality of ultrasound images is an image in which an entire or a part of the lesion part is imaged.

### Claim 5 (depends on 2)

The ultrasound diagnostic apparatus according to claim 2,
wherein the plurality of ultrasound images are a thinned-out image, an interpolated image, or a synthesized image from the images forming the video in which the lesion part is imaged.

### Claim 6 (depends on 1)

The ultrasound diagnostic apparatus according to claim 1,
wherein the processor is further configured to
form an enclosing line surrounding the lesion part on the basis image, and
superimpose and display the enclosing line on the basis image.

### Claim 7 (depends on 2)

The ultrasound diagnostic apparatus according to claim 2,
wherein the processor is further configured to
form an enclosing line surrounding the lesion part on the basis image, and
superimpose and display the enclosing line on the basis image.

### Claim 8 (depends on 3)

The ultrasound diagnostic apparatus according to claim 3,
wherein the processor is further configured to
form an enclosing line surrounding the lesion part on the basis image, and
superimpose and display the enclosing line on the basis image.

### Claim 9 (depends on 1)

The ultrasound diagnostic apparatus according to claim 1,
wherein the processor is further configured to
form a heat map in which a contribution rate of a portion contributing to calculation of the score is represented by color shading or color difference, in the basis image, and
display the heat map on the monitor.

### Claim 10 (depends on 2)

The ultrasound diagnostic apparatus according to claim 2,
wherein the processor is further configured to
form a heat map in which a contribution rate of a portion contributing to calculation of the score is represented by color shading or color difference, in the basis image, and
display the heat map on the monitor.

### Claim 11 (depends on 3)

The ultrasound diagnostic apparatus according to claim 3,
wherein the processor is further configured to
form a heat map in which a contribution rate of a portion contributing to calculation of the score is represented by color shading or color difference, in the basis image, and
display the heat map on the monitor.

### Claim 12 (depends on 1)

The ultrasound diagnostic apparatus according to claim 1,
wherein the processor is further configured to calculate the score by a machine learning model trained for the multidimensional image feature of the ultrasound image.

### Claim 13 (depends on 2)

The ultrasound diagnostic apparatus according to claim 2,
wherein the processor is further configured to calculate the score by a machine learning model trained for the multidimensional image feature of the ultrasound image.

### Claim 14 (depends on 1)

The ultrasound diagnostic apparatus according to claim 1,
wherein the processor is further configured to perform determination based on the score of the ultrasound image in which the imaged lesion part is the largest among the plurality of ultrasound images.

### Claim 15 (depends on 2)

The ultrasound diagnostic apparatus according to claim 2,
wherein the processor is further configured to perform determination based on the score of the ultrasound image in which the imaged lesion part is the largest among the plurality of ultrasound images.

### Claim 16 (depends on 1)

The ultrasound diagnostic apparatus according to claim 1,
wherein the processor is further configured to perform determination based on the majority, the maximum value, the median, or the mode of the scores of the plurality of ultrasound images.

### Claim 17 (depends on 2)

The ultrasound diagnostic apparatus according to claim 2,
wherein the processor is further configured to perform determination based on the majority, the maximum value, the median, or the mode of the scores of the plurality of ultrasound images.

### Claim 18 (depends on 1)

The ultrasound diagnostic apparatus according to claim 1,
wherein the processor is further configured to exclude outliers from the scores of the plurality of ultrasound images, and
perform determination based on the majority, the maximum value, the median, or the mode of the scores of the plurality of ultrasound images from which the outliers have been excluded.

### Claim 19 (depends on 2)

The ultrasound diagnostic apparatus according to claim 2,
wherein the processor is further configured to
exclude outliers from the scores of the plurality of ultrasound images, and
perform determination based on the majority, the maximum value, the median, or the mode of the scores of the plurality of ultrasound images from which the outliers have been excluded.

### Claim 20

A control method of an ultrasound diagnostic apparatus that performs determination on a lesion part of a subject based on a plurality of ultrasound images in which the lesion part is imaged, the control method comprising:
calculating a multidimensional image feature in each of the plurality of ultrasound images by analyzing the plurality of ultrasound images;
calculating a score of the lesion part in each of the plurality of ultrasound images based on the multidimensional image feature;
performing determination on the lesion part based on the score calculated for each of the plurality of ultrasound images;
extracting the ultrasound image best representing a determination result for the lesion part from the plurality of ultrasound images, as a basis image; and
displaying the determination result and the basis image on a monitor.
