# US 2021/0228177 A1 · Ultrasonic diagnostic apparatus, learning apparatus, and image processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0228177 A1
- Document ID: US20210228177A1
- Status: Published application
- Kind: A1
- Application number: 17/153,351
- Filed: 2021-01-20
- Published: 2021-07-29
- Earliest claimed: 2020-01-24
- Applicants: Canon Kabushiki Kaisha
- Inventors: Shoya Sasaki; Naoya Iizuka; Kenichi Nagae
- Web page: https://patentgrep.com/patent/US20210228177A1

## CPC

- A61B 8/06: Measuring blood flow
- A61B 8/4444: {related to the probe}
- A61B 8/461: {Displaying means of special interest}
- A61B 8/488: {involving Doppler signals}
- A61B 8/5207: {involving processing of raw data to produce diagnostic data, e.g. for generating an image}
- A61B 8/5223: {for extracting a diagnostic or physiological parameter from medical diagnostic data (for algorithms to analyse biomedical images G06T7/0012)}
- A61B 8/5246: {combining images from the same or different imaging techniques, e.g. color Doppler and B-mode}
- G06N 20/00: Machine learning
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An ultrasonic diagnostic apparatus, comprising: an ultrasonic probe configured to transmit and receive ultrasonic waves to and from an object; and an estimation calculating unit configured to estimate data based on blood flow information from third data based on a received signal for image generation received by the ultrasonic probe by using a model having been machine-learned from learning data including first data based on a received signal for image generation that is obtained from an observation region and second data based on blood flow information of the observation region.

## Claims

### Claim 1

An ultrasonic diagnostic apparatus, comprising:
an ultrasonic probe configured to transmit and receive ultrasonic waves to and from an object; and
an estimation calculating unit configured to estimate data based on blood flow information from third data based on a received signal for image generation received by the ultrasonic probe by using a model having been machine-learned from learning data including first data based on a received signal for image generation that is obtained from an observation region and second data based on blood flow information of the observation region.

### Claim 2 (depends on 1)

The ultrasonic diagnostic apparatus according to claim 1, wherein the third data includes a received signal obtained by scanning the observation region in order to generate a B-mode image or B-mode image data based on the received signal.

### Claim 3 (depends on 1)

The ultrasonic diagnostic apparatus according to claim 1, wherein the third data includes a received signal obtained by transmitting a plane wave or a diffuse wave or image data based on the received signal.

### Claim 4 (depends on 2)

The ultrasonic diagnostic apparatus according to claim 2, wherein the third data includes a plurality of received signals of a reflected ultrasonic wave obtained by scanning the observation region a plurality of times or image data based on the plurality of received signals.

### Claim 5 (depends on 1)

The ultrasonic diagnostic apparatus according to claim 1, wherein the third data includes a part of received signals, obtained by performing transmission and reception of an ultrasonic wave a plurality of times on each of a plurality of scan lines of the observation region in order to acquire blood flow information of the observation region, or image data based on the part of received signals.

### Claim 6 (depends on 1)

The ultrasonic diagnostic apparatus according to claim 1, wherein the third data further includes at least any of a wavefront shape of a transmission ultrasonic wave, a transmission frequency of a transmission ultrasonic wave, a type of the object, and a contact angle of the ultrasonic probe relative to the object.

### Claim 7 (depends on 1)

The ultrasonic diagnostic apparatus according to claim 1, wherein the estimation calculating unit includes a plurality of learning models having been machine-learned so as to estimate data based on blood flow information of different velocity ranges from the third data.

### Claim 8 (depends on 1)

The ultrasonic diagnostic apparatus according to claim 1, further comprising a Doppler processing unit configured to extract blood flow information from received signals of a reflected ultrasonic wave obtained by performing transmission/reception of an ultrasonic wave a plurality of times on each of a plurality of scan lines of the observation region and generates Doppler image data based on the blood flow information.

### Claim 9 (depends on 8)

The ultrasonic diagnostic apparatus according to claim 8, wherein the third data includes a part of received signals for generating the Doppler image data.

### Claim 10 (depends on 1)

The ultrasonic diagnostic apparatus according to claim 1, further comprising a control unit configured to perform control of a display image to be output to a display apparatus, wherein the control unit has a display mode in which the display image is updated based on data estimated by the estimation calculating unit.

### Claim 11 (depends on 8)

The ultrasonic diagnostic apparatus according to claim 8, further comprising a control unit configured to perform control of a display image to be output to a display apparatus, wherein the control unit has a display mode in which the display image is updated based on the Doppler image data, instead of based on data estimated by the estimation calculating unit and a display mode in which the display image is updated based on the Doppler image data and the data estimated by the estimation calculating unit.

### Claim 12 (depends on 11)

The ultrasonic diagnostic apparatus according to claim 11, wherein in the display mode in which the display image is updated based on the Doppler image data and the data estimated by the estimation calculating unit, the control unit, after updating the display image based on the Doppler image data, repeatedly performs processing of updating the display image a prescribed number of times consecutively based on the data estimated by the estimation calculating unit.

### Claim 13 (depends on 12)

The ultrasonic diagnostic apparatus according to claim 12, wherein the control unit changes the prescribed number of times in accordance with an input from a user.

### Claim 14 (depends on 11)

The ultrasonic diagnostic apparatus according to claim 11, wherein the control unit saves, when receiving an instruction to save an image from a user, both of or one of the Doppler image data having been acquired at a timing closest to a timing at which the instruction has been received and the data estimated by the estimation calculating unit.

### Claim 15 (depends on 8)

The ultrasonic diagnostic apparatus according to claim 8, further comprising a control unit configured to perform control of a display image to be output to a display apparatus, wherein the control unit displays, side by side, an image based on the Doppler image data and an image based on the data estimated by the estimation calculating unit.

### Claim 16 (depends on 1)

A learning apparatus performing machine learning of a learning model to be used by the estimation calculating unit of the ultrasonic diagnostic apparatus according to claim 1, the learning apparatus comprising
a learning unit configured to perform machine learning of the learning model by using learning data that includes data, based on a received signal of a reflected ultrasonic wave obtained from an observation region, as input data and blood flow information, extracted from a reflected ultrasonic wave obtained by scanning the observation region a plurality of times, as correct answer data.

### Claim 17

An image processing method comprising:
a receiving step of transmitting an ultrasonic wave to an object and receiving a reflected ultrasonic wave from the object by using an ultrasonic probe;
an estimation calculating step of estimating data based on the blood flow information from third data based on a received signal for image generation received in the receiving step by using a learning model having been machine-learned using learning data including first data based on a received signal for image generation that is obtained from an observation region and second data based on blood flow information of the observation region; and
a displaying step of displaying on a display apparatus an image based on data estimated in the estimation calculating step.

### Claim 18 (depends on 17)

A computer-readable medium non-transitorily storing a program for causing a processor to execute the respective steps of the image processing method according to claim 17.
