# US 2021/0280298 A1 · Methods and systems for detecting abnormalities in medical images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0280298 A1
- Document ID: US20210280298A1
- Status: Published application
- Kind: A1
- Application number: 16/807,912
- Filed: 2020-03-03
- Published: 2021-09-09
- Earliest claimed: 2020-03-03
- Assignees: GE Precision Healthcare LLC
- Applicants: GE Precision Healthcare LLC
- Inventors: Eigil Samset; David Bates
- Web page: https://patentgrep.com/patent/US20210280298A1

## CPC

- G16H 30/40: for processing medical images, e.g. editing
- A61B 6/032: {Transmission computed tomography [CT]}
- A61B 6/037: {Emission tomography}
- A61B 6/5217: {extracting a diagnostic or physiological parameter from medical diagnostic data}
- A61B 8/463: {characterised by displaying multiple images or images and diagnostic data on one display}
- A61B 8/465: {adapted to display user selection data, e.g. icons or menus}
- A61B 8/469: {for selection of a region of interest}
- A61B 8/5223: {for extracting a diagnostic or physiological parameter from medical diagnostic data (for algorithms to analyse biomedical images G06T7/0012)}
- A61B 8/54: {Control of the diagnostic device}
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G16H 15/00: ICT specially adapted for medical reports, e.g. generation or transmission thereof
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/50: for simulation or modelling of medical disorders
- G16H 70/20: relating to practices or guidelines
- G16H 70/60: relating to pathologies
- A61B 6/5247: {combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound}
- A61B 8/06: Measuring blood flow
- A61B 8/4444: {related to the probe}
- A61B 8/485: {involving measuring strain or elastic properties}
- A61B 8/486: {involving arbitrary m-mode}
- A61B 8/488: {involving Doppler signals}
- A61B 8/5261: {combining images from different diagnostic modalities, e.g. ultrasound and X-ray}
- G16H 40/60: for the operation of medical equipment or devices
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Various methods and systems are provided for a medical imaging system. In one embodiment, a method comprises acquiring medical imaging data while executing a first imaging protocol, detecting a potential abnormality by evaluating the acquired medical imaging data with an artificial intelligence system, and outputting a first notification regarding the potential abnormality to a display, the first notification including an option to accept the first notification and an option to reject the first notification. In this way, an operator of an ultrasound imaging system may be alerted to a patient abnormality during a scan, thereby enabling the operator to further evaluate the potential abnormality without distracting the operator from controlling the medical imaging system.

## Claims

### Claim 1

A method, comprising:
acquiring medical imaging data according to a first imaging protocol;
detecting a potential abnormality by evaluating the acquired medical imaging data with an artificial intelligence system; and
outputting a first notification regarding the potential abnormality to a display, the first notification including an option to accept the first notification and an option to reject the first notification.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
responsive to a selection of the option to reject the first notification, removing the first notification from the display; and
responsive to a selection of the option to accept the first notification, outputting a report regarding the detected potential abnormality to the display.

### Claim 3 (depends on 2)

The method of claim 2, wherein the report regarding the detected potential abnormality includes guidance for verifying the detected potential abnormality using the first imaging protocol.

### Claim 4 (depends on 2)

The method of claim 2, wherein the report regarding the detected potential abnormality includes guidance for verifying the detected potential abnormality using a second imaging protocol, the second imaging protocol including at least one of a view and an acquisition mode that is not included in the first imaging protocol, and wherein outputting the report pauses the first imaging protocol until the second imaging protocol is completed.

### Claim 5 (depends on 2)

The method of claim 2, wherein the first notification further includes an option to postpone the first notification.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
responsive to none of the option to accept the first notification, the option to postpone the first notification, and the option to reject the first notification being selected after a threshold duration has elapsed since outputting the first notification to the display, removing the first notification from the display and storing information given by the first notification at a notification center.

### Claim 7 (depends on 5)

The method of claim 5, wherein storing the information given by the first notification at the notification center includes outputting an indicator on the display at an icon for the notification center, and the method further comprises:
responsive to the notification center being selected, outputting a second notification to the display, the second notification including the information given by the first notification and further including an option to accept the second notification, an option to postpone the second notification, and an option to reject the second notification; and
responsive to the option to accept the second notification being selected, outputting the report regarding the detected potential abnormality to the display.

### Claim 8 (depends on 5)

The method of claim 5, further comprising:
responsive to a selection of the option to postpone the first notification, outputting the report regarding the detected potential abnormality to the display upon completion of the first imaging protocol.

### Claim 9 (depends on 1)

The method of claim 1, wherein outputting the first notification is responsive to an off state of a do not disturb setting.

### Claim 10 (depends on 1)

The method of claim 1, wherein the potential abnormality is a parameter of an anatomical feature imaged in the acquired medical imaging data that is at least one of outside of a standardized range and pathological, and wherein detecting the potential abnormality by evaluating the acquired medical imaging data with the artificial intelligence system includes evaluating the acquired medical imaging data in real-time during the acquiring, the artificial intelligence system including one or more deep neural networks.

### Claim 11 (depends on 1)

The method of claim 1, wherein the medical imaging data includes at least one of ultrasound imaging data, magnetic resonance imaging data, computed tomography data, x-ray data, and positron emission tomography data.

### Claim 12

A method, comprising:
detecting a potential abnormality in an imaged region of a patient;
receiving acceptance, postponement, or rejection of a notification regarding the potential abnormality;
instantaneously outputting a report on the potential abnormality responsive to receiving the acceptance of the notification;
delaying outputting the report on the potential abnormality responsive to receiving the postponement of the notification; and
logging the detected potential abnormality without outputting the report responsive to receiving the rejection of the notification.

### Claim 13 (depends on 12)

The method of claim 12, wherein receiving the acceptance, postponement, or rejection of the notification regarding the potential abnormality includes:
outputting the notification to a display device, the notification including an acceptance input, a postponement input and a rejection input;
receiving acceptance of the notification via the acceptance input;
receiving postponement of the notification via the postponement input; and
receiving rejection of the notification via the rejection input.

### Claim 14 (depends on 13)

The method of claim 13, wherein detecting the potential abnormality in the imaged region of the patient includes:
acquiring medical imaging data of the imaged region via an imaging protocol; and
analyzing the medical imaging data for potential abnormalities via an artificial intelligence system.

### Claim 15 (depends on 14)

The method of claim 14, wherein analyzing the medical imaging data for potential abnormalities via the artificial intelligence system includes analyzing the medical imaging data in real-time during the acquiring, and outputting the notification to the display device includes outputting the notification in a region of the display device not overlapping controls for the acquiring.

### Claim 16 (depends on 14)

The method of claim 14, wherein analyzing the medical imaging data for potential abnormalities includes analyzing the medical imaging data after acquiring the medical imaging data.

### Claim 17 (depends on 14)

The method of claim 14, wherein delaying outputting the report on the potential abnormality responsive to receiving the postponement of the notification includes outputting the report after the imaging protocol is finished.

### Claim 18 (depends on 13)

The method of claim 13, wherein outputting the notification to the display is responsive to receiving selection of a notification center.

### Claim 19

A system, comprising:
an ultrasound probe;
a display device; and
a processor configured with instructions in non-transitory memory that, when executed, cause the processor to:
acquire ultrasound data via the ultrasound probe according to a first imaging protocol;
evaluate the ultrasound data with a deep neural network to detect an abnormality; and
output an abnormality report on the display device responsive to detecting the abnormality and responsive to receiving acceptance of a notification.

### Claim 20 (depends on 19)

The system of claim 19, wherein the abnormality report includes a type of the abnormality, a location of the abnormality, and additional views to be acquired using at least one of the first imaging protocol and a second imaging protocol, the second imaging protocol including a different imaging mode than the first imaging protocol, and the processor is further configured with instructions in the non-transitory memory that, when executed, cause the processor to:
output the abnormality report on the display device responsive to detecting the abnormality, receiving postponement of the notification, and the first imaging protocol completing.

### Claim 21 (depends on 19)

The system of claim 19, wherein the processor is further configured with instructions in the non-transitory memory that, when executed, cause the processor to output the notification at a pre-determined timing during the first imaging protocol or responsive to receiving a pre-defined input.
