# US 2017/0360396 A1 · Ultrasound imaging apparatus and method for segmenting anatomical objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0360396 A1
- Document ID: US20170360396A1
- Status: Published application
- Kind: A1
- Application number: 15/540,297
- Filed: 2016-01-04
- Published: 2017-12-21
- Earliest claimed: 2015-01-06
- Assignees: Koninklijke Philips N.V.
- Applicants: Koninklijke Philips N.V.
- Inventors: JOCHEN PETERS; AMIR MOHAMMAD TAHMASEBI MARAGHOOSH; JUERGEN WEESE; CHRISTIAN BUERGER
- Web page: https://patentgrep.com/patent/US20170360396A1

## CPC

- A61B 8/14: Echotomography
- A61B 8/5223: {for extracting a diagnostic or physiological parameter from medical diagnostic data (for algorithms to analyse biomedical images G06T7/0012)}
- G06T 7/0014: {using an image reference approach}
- G06T 7/12: Edge-based segmentation
- G06T 7/149: involving deformable models, e.g. active contour models
- G06T 7/75: {involving models}
- G16H 50/30: for calculating health indices; for individual health risk assessment
- A61B 8/468: {allowing annotation or message recording}
- G06T 2200/04: involving 3D image data
- G06T 2207/10132: Ultrasound image
- G06T 2207/10136: 3D ultrasound image
- G06T 2207/20128: Atlas-based segmentation
- G06T 2207/30004: Biomedical image processing
- G06T 2207/30244: Camera pose
- G06T 2219/004: Annotating, labelling
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

An ultrasound imaging apparatus (10) for segmenting an anatomical object in a field of view (29) of an ultrasound acquisition unit (14) is disclosed. The ultrasound imaging apparatus comprises a data interface (32) configured to receive a two-dimensional ultrasound data (30) of the object in the field of view in an image plane from the ultrasound acquisition unit and to receive a three-dimensional segmentation model (46) as a three-dimensional representation of the object from a segmentation unit (36). An image processor (34) is configured to determine a two-dimensional segmentation model (50) on the basis of the three-dimensional segmentation model and a segmentation plane (48), wherein the segmentation plane and an image plane of the two-dimensional ultrasound data correspond to each other. The image processor is configured to adapt a contour of the two-dimensional segmentation model to the two-dimensional ultrasound data on the basis of pattern detection and where the image processor is configured to provide annotated two-dimensional image data (42) on the basis of the two-dimensional ultrasound data and the adapted segmentation model aligned to the two-dimensional ultrasound data.

## Claims

### Claim 1

An ultrasound imaging apparatus for segmenting an anatomical object in a field of view of an ultrasound acquisition unit during an image-guided intervention, comprising:
a data interface configured to receive a continuous two-dimensional ultrasound data stream, provided as live image data, of the object in the field of view in an image plane from the ultrasound acquisition unit and to receive a three-dimensional segmentation model as a three-dimensional representation of the object from a segmentation unit,
an image processor configured to determine a two-dimensional segmentation model on the basis of the three-dimensional segmentation model and a segmentation plane, wherein the segmentation plane and an image plane of the continuous two-dimensional ultrasound data stream correspond to each other, and
wherein the image processor is configured to adapt a contour of the two-dimensional segmentation model to the continuous two-dimensional ultrasound data stream on the basis of pattern detection, and wherein the image processor is configured to provide annotated two-dimensional live image data on the basis of the continuous two-dimensional ultrasound data stream and the adapted segmentation model adapted to the continuous two-dimensional ultrasound data stream.

### Claim 1

(canceled)

### Claim 2 (depends on 1)

An ultrasound imaging apparatus as claimed in claim 1, wherein the segmentation unit comprises a data interface configured to receive three-dimensional medical image data of the object, and wherein the segmentation unit is configured to adapt a predefined three-dimensional segmentation model of the anatomical object on the basis of the three-dimensional medical image data prior to the image-guided intervention.

### Claim 3 (depends on 2)

An ultrasound imaging apparatus as claimed in claim 2, wherein the segmentation unit is configured to provide the adapted three-dimensional segmentation model to the data interface.

### Claim 4 (depends on 1)

An ultrasound imaging apparatus as claimed in claim 1, wherein the three-dimensional segmentation model and/or the two-dimensional segmentation model include a plurality of surface elements or line elements forming the representation of the anatomical object surface or contour and wherein anatomical information and/or pattern information are assigned to the surface elements or line elements.

### Claim 5 (depends on 4)

An ultrasound imaging apparatus as claimed in claim 4, wherein the image processor is configured to adapt a contour of the two-dimensional segmentation model to the ultrasound data on the basis of pattern information.

### Claim 6 (depends on 4)

An ultrasound imaging apparatus as claimed in claim 4, wherein the pattern information comprise ultrasound data intensity information of the object and wherein the image processor is configured to adapt a contour of the two-dimensional segmentation model to corresponding intensities in the continuous two-dimensional ultrasound data stream.

### Claim 7 (depends on 4)

An ultrasound imaging apparatus as claimed in claim 4, wherein the image processor is configured to display the anatomical information in the annotated two-dimensional live image data.

### Claim 8 (depends on 1)

An ultrasound imaging apparatus as claimed in claim 1, further comprising a position determining unit for determining a position and a viewing direction of the ultrasound acquisition unit and for determining the image plane of the continuous two-dimensional ultrasound data stream, wherein the image processor is configured to determine the segmentation plane corresponding to the determined image plane.

### Claim 9 (depends on 1)

An ultrasound imaging apparatus as claimed in claim 1, wherein the segmentation plane is predefined in relation to the three-dimensional segmentation model and wherein the image plane is adapted to the predefined segmentation plane.

### Claim 10 (depends on 9)

An ultrasound imaging apparatus as claimed in claim 9, further comprising a user interface, wherein the segmentation plane is predefined by the user via the user interface.

### Claim 12

A method for identifying an anatomical object in a field of view of an ultrasound acquisition unit during image-guided intervention, comprising the steps of:
receiving a continuous two-dimensional ultrasound data stream, provided as live image data, in an image plane of the object in the field of view from the ultrasound acquisition unit;
receiving a three-dimensional segmentation model as a three-dimensional representation of the object from a segmentation unit,
determining a two-dimensional segmentation model on the basis of the three-dimensional segmentation model and a segmentation plane intersecting the three-dimensional segmentation model, wherein the segmentation plane and the image plane correspond to each other,
deforming a contour of the two-dimensional segmentation model to the continuous two-dimensional ultrasound data stream on the basis of pattern detection in the continuous two-dimensional ultrasound data stream, and
providing annotated two-dimensional live image data on the basis of the continuous two-dimensional ultrasound data stream and the adapted two-dimensional segmentation model aligned to the continuous two-dimensional ultrasound data stream.

### Claim 13 (depends on 12)

A computer program comprising program means for causing a computer to carry out the steps of the method as claimed in claim 12 when said computer program is carried out on a computer.
