# US 2023/0267618 A1 · Systems and methods for automated ultrasound examination

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0267618 A1
- Document ID: US20230267618A1
- Status: Published application
- Kind: A1
- Application number: 17/651,770
- Filed: 2022-02-18
- Published: 2023-08-24
- Earliest claimed: 2022-02-18
- Assignees: GE Precision Healthcare LLC
- Applicants: GE Precision Healthcare LLC
- Inventors: Anuprriya Gogna; Vikram Melapudi; Rahul Venkataramani
- Web page: https://patentgrep.com/patent/US20230267618A1

## CPC

- G06T 7/12: Edge-based segmentation
- A61B 8/08: Clinical applications (A61B8/02, A61B8/04, A61B8/06 take precedence)
- A61B 8/085: {for locating body or organic structures, e.g. tumours, calculi, blood vessels, nodules}
- A61B 8/0866: {involving foetal diagnosis; pre-natal or peri-natal diagnosis of the baby}
- A61B 8/463: {characterised by displaying multiple images or images and diagnostic data on one display}
- A61B 8/483: {involving the acquisition of a 3D volume of data}
- A61B 8/5223: {for extracting a diagnostic or physiological parameter from medical diagnostic data (for algorithms to analyse biomedical images G06T7/0012)}
- A61B 8/523: {for generating planar views from image data in a user selectable plane not corresponding to the acquisition plane}
- G06T 7/0012: {Biomedical image inspection}
- G06T 11/00: Two-dimensional [2D] image generation
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- A61B 8/4427: {Device being portable or laptop-like}
- G06T 2207/10136: 3D ultrasound image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30004: Biomedical image processing
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

Methods and systems are provided for an automated ultrasound exam. In one example, a method includes identifying a view plane of interest based on one or more 3D ultrasound images, obtaining a view plane image including the view plane of interest from a 3D volume of ultrasound data of a patient, where the one or more 3D ultrasound images are generated from the 3D volume of ultrasound data, segmenting an anatomical region of interest (ROI) within the view plane image to generate a contour of the anatomical ROI, and displaying the contour on the view plane image.

## Claims

### Claim 1

A method, comprising:
identifying a view plane of interest based on one or more 3D ultrasound images;
obtaining a view plane image including the view plane of interest from a 3D volume of ultrasound data of a patient, where the one or more 3D ultrasound images are generated from the 3D volume of ultrasound data;
segmenting an anatomical region of interest (ROI) within the view plane image to generate a contour of the anatomical ROI; and
displaying the contour on the view plane image.

### Claim 2 (depends on 1)

The method of claim 1, wherein the view plane of interest includes a minimal hiatal dimension (MHD) plane and the anatomical ROI comprises a levator hiatus.

### Claim 3 (depends on 1)

The method of claim 1, further comprising identifying a first diameter of the contour and a second diameter of the contour, and displaying the first diameter and the second diameter.

### Claim 4 (depends on 1)

The method of claim 1, wherein segmenting the anatomical ROI to generate the contour comprises entering the view plane image as input into a segmentation model trained to output an initial segmentation of the anatomical ROI.

### Claim 5 (depends on 4)

The method of claim 4, wherein segmenting the anatomical ROI to generate the contour further comprises adjusting a template segmentation of the anatomical ROI based on the initial segmentation to generate an adjusted segmentation template and entering the adjusted segmentation template and the view plane image as input to a contour refinement model trained to output a refined segmentation of the anatomical ROI, the contour based on the refined segmentation.

### Claim 6 (depends on 5)

The method of claim 5, wherein the segmentation model and the contour refinement model are separate models and are trained independently of one another.

### Claim 7 (depends on 5)

The method of claim 5, wherein the template segmentation represents an average segmentation of the anatomical ROI from a plurality of patients.

### Claim 8 (depends on 1)

The method of claim 1, wherein identifying the view plane of interest based on the one or more 3D ultrasound images comprises entering the one or more 3D ultrasound images as input to a view plane model trained to output a 2D segmentation mask indicating a location of the view plane of interest within the 3D volume of ultrasound data.

### Claim 9

A system, comprising:
a display device; and
a computing device operably coupled to the display device and including memory storing instructions executable by a processor to:
identify a view plane of interest based on one or more 3D ultrasound images;
obtain a view plane image including the view plane of interest from a 3D volume of ultrasound data of a patient, where the one or more 3D ultrasound images are generated from the 3D volume of ultrasound data;
segment an anatomical region of interest (ROI) within the view plane image to generate a contour of the anatomical ROI; and
display the contour on the view plane image on the display device.

### Claim 10 (depends on 9)

The system of claim 9, wherein the memory stores a view plane model trained to identify the view plane of interest using the one or more 3D ultrasound images as input.

### Claim 11 (depends on 10)

The system of claim 10, wherein the view plane model comprises one or more 3D convolution layers, a flattening layer, and a 2D network.

### Claim 12 (depends on 9)

The system of claim 9, wherein the memory stores a segmentation model and a contour refinement model that are deployed to segment the anatomical ROI.

### Claim 13 (depends on 12)

The system of claim 12, wherein the segmentation model is trained to output an initial segmentation of the anatomical ROI using the view plane image as input, and the contour refinement model is trained to output a refined segmentation of the anatomical ROI using the view plane image and an adjusted segmentation template, the adjusted segmentation template including a template segmentation adjusted based on the initial segmentation, and wherein the contour of the anatomical ROI is generated from the refined segmentation.

### Claim 14 (depends on 9)

The system of claim 9, wherein the view plane of interest includes a minimal hiatal dimension (MHD) plane and the anatomical ROI comprises a levator hiatus.

### Claim 15

A method for an automated pelvic ultrasound exam, comprising:
identifying a minimal hiatal dimension (MHD) plane based on one or more 3D ultrasound images generated from a 3D volume of ultrasound data of a patient;
displaying, on a display device, an indicator of a location of the MHD plane relative to one of the one or more 3D ultrasound images;
obtaining an MHD image including the MHD plane from the 3D volume of ultrasound data;
segmenting a levator hiatus within the MHD image to generate a contour of the levator hiatus;
performing one or more measurements of the levator hiatus based on the contour; and
displaying, on the display device, results of the one or more measurements and/or displaying the contour on the MHD image.

### Claim 16 (depends on 15)

The method of claim 15, wherein the 3D volume of ultrasound data is a first 3D volume of ultrasound data acquired while the patient is in a first condition, and further comprising:
identifying the MHD plane based on one or more second 3D ultrasound images generated from a second 3D volume of ultrasound data of the patient acquired while the patient is in a second condition;
displaying, on the display device, a second indicator of a second location of the MHD plane relative to one of the one or more second 3D ultrasound images;
obtaining a second MHD image including the MHD plane from the second 3D volume of ultrasound data;
segmenting the levator hiatus within the second MHD image to generate a second contour of the levator hiatus;
performing one or more second measurements of the levator hiatus based on the second contour; and
displaying, on the display device, results of the one or more second measurements and/or the second contour on the second MHD image.

### Claim 17 (depends on 15)

The method of claim 15, wherein identifying the MHD plane based on the one or more 3D ultrasound images comprises entering the one or more 3D ultrasound images as input to a view plane model trained to output a 2D segmentation mask indicating the location of the MHD plane within the 3D volume of ultrasound data.

### Claim 18 (depends on 15)

The method of claim 15, wherein segmenting the levator hiatus to generate the contour comprises entering the MHD image as input into a segmentation model trained to output an initial segmentation of the levator hiatus.

### Claim 19 (depends on 18)

The method of claim 18, wherein segmenting the levator hiatus to generate the contour further comprises adjusting a template segmentation of the levator hiatus based on the initial segmentation to generate an adjusted segmentation template and entering the adjusted segmentation template and the MHD image as input to a contour refinement model trained to output a refined segmentation of the levator hiatus, the contour based on the refined segmentation.

### Claim 20 (depends on 19)

The method of claim 19, wherein the template segmentation represents an average segmentation of the levator hiatus from a plurality of patients.
