# US 2023/0054610 A1 · Contextual multiplanar reconstruction of three-dimensional ultrasound imaging data and associated devices, systems, and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0054610 A1
- Document ID: US20230054610A1
- Status: Published application
- Kind: A1
- Application number: 17/908,289
- Filed: 2021-02-22
- Published: 2023-02-23
- Earliest claimed: 2020-03-05
- Assignees: Koninklijke Philips N.V.
- Applicants: Koninklijke Philips N.V.
- Inventors: David Nigel Roundhill; Tobias Klinder; Alexander Schmidt-Richberg; Matthias Lenga; Eliza Teodora Orasanu; Cristian Lorenz
- Web page: https://patentgrep.com/patent/US20230054610A1

## CPC

- G06Q 10/063: Operations research, analysis or management
- A61B 8/483: {involving the acquisition of a 3D volume of data}
- A61B 8/523: {for generating planar views from image data in a user selectable plane not corresponding to the acquisition plane}
- G01S 15/8993: {Three dimensional imaging systems}
- G06F 9/451: Execution arrangements for user interfaces
- G06Q 10/0631: Resource planning, allocation, distributing or scheduling for enterprises or organisations
- G06Q 10/0639: Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q 10/20: Administration of product repair or maintenance
- G06Q 50/40: Business processes related to the transportation industry (shipping G06Q10/083)
- G06T 19/003: {Navigation within 3D models or images}
- G08G 5/55: for a single aircraft
- G08G 5/57: for unmanned aircraft
- G08G 5/727: {from a ground station}
- A61B 8/145: {characterised by scanning multiple planes}
- G01S 7/52073: {Production of cursor lines, markers or indicia by electronic means}
- G06T 2210/41: Medical
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

An ultrasound imaging system includes a processor circuit in communication with an ultrasound transducer configured to receive three-dimensional ultrasound data of an anatomy, and generate a target image corresponding to a target image plane of the anatomy, and a plurality of adjacent images corresponding to image planes adjacent to the target image plane along a simulated motion path. The processor circuit is further configured to display the target image, receive a user input representative of a direction of motion along the simulated motion path, and display an adjacent image of the plurality of adjacent images corresponding to the direction of motion. Accordingly, the user can observe the target image in its spatial context by scanning through the target image and one or more adjacent images on the display as if the ultrasound transducer were being scanned along the simulated motion path.

## Claims

### Claim 1

An ultrasound imaging apparatus, comprising:
a processor circuit configured to:
receive, from an ultrasound probe communicatively coupled to the processor circuit, three-dimensional ultrasound data of an anatomy;
generate, from the three-dimensional ultrasound data, a target image corresponding to a target image plane of the anatomy;
generate, from the three-dimensional ultrasound data, a plurality of adjacent images corresponding to image planes adjacent to the target image plane along a simulated motion path, wherein the target image and the plurality of adjacent images comprise two-dimensional images based on the three-dimensional ultrasound data;
output, to a display in communication with the processor circuit, the target image;
receive a user input representative of a direction of motion along the simulated motion path; and
output, to the display, an adjacent image of the plurality of adjacent images corresponding to the direction of motion.

### Claim 2 (depends on 1)

The ultrasound imaging apparatus of claim 1, further comprising the ultrasound probe.

### Claim 3 (depends on 1)

The ultrasound imaging apparatus of claim 1, wherein the processor circuit is configured to:
interpolate between a position and orientation of the target image and a position and orientation of the adjacent image to generate an interpolated image; and
output the interpolated image to the display.

### Claim 4 (depends on 1)

The ultrasound imaging apparatus of claim 1, wherein the processor circuit is configured to:
determine a direction of uncertainty relative to the target image plane; and
determine the simulated motion path based on the determined direction of uncertainty.

### Claim 5 (depends on 4)

The ultrasound imaging apparatus of claim 4, wherein the processor circuit is configured to apply a covariance matrix to the three-dimensional ultrasound data to determine the direction of uncertainty.

### Claim 6 (depends on 1)

The ultrasound imaging apparatus of claim 1, wherein the processor circuit is configured to:
identify, from the three-dimensional ultrasound data, an image plane of interest different from the target image and the adjacent image; and
determine the simulated motion path based on the target image, the adjacent image, and the image of interest.

### Claim 7 (depends on 6)

The ultrasound imaging apparatus of claim 6, wherein the processor circuit is configured to output the image of interest in response to receiving the user input.

### Claim 8 (depends on 1)

The ultrasound imaging apparatus of claim 1, wherein the plurality of adjacent images comprises a plurality of parallel adjacent images associated with a plurality of parallel adjacent image planes.

### Claim 9 (depends on 1)

The ultrasound imaging apparatus of claim 1,
wherein the processor circuit is configured to generate the target image to exclude an anatomical feature, and
wherein the processor circuit is configured to generate the adjacent image to include the anatomical feature.

### Claim 10 (depends on 1)

The ultrasound imaging apparatus of claim 1, wherein the processor circuit is further configured to output, to the display, a graphical representation of an adjacent image plane associated with the adjacent image, wherein the graphical representation includes:
a diagrammatic view of a body portion associated with the target image; and
an indicator of the adjacent image plane overlaid on the diagrammatic view of the body portion.

### Claim 11

A method for reconstructing ultrasound images, comprising:
receiving, three-dimensional ultrasound data of an anatomy obtained by an ultrasound probe;
generating, from the three-dimensional ultrasound data, a target image corresponding to a target image plane of the anatomy;
generating, from the three-dimensional ultrasound data, a plurality of adjacent images corresponding to image planes adjacent to the target image plane along a simulated motion path, wherein the target image and the plurality of adjacent images comprise two-dimensional images based on the three-dimensional ultrasound data;
outputting, to a display, the target image;
receiving a user input representative of a direction of motion along the simulated motion path; and
outputting, to a display, an adjacent image of the plurality of adjacent images corresponding to the direction of motion.

### Claim 12 (depends on 11)

The method of claim 11,
wherein generating the plurality of adjacent images comprises interpolating between a position and orientation of the target image and a position and orientation of the adjacent image to generate an interpolated image, and
wherein the method further comprises outputting the interpolated image to the display.

### Claim 13 (depends on 11)

The method of claim 11, wherein generating the plurality of adjacent images comprises:
determining a direction of uncertainty relative to the target image plane; and
determining the simulated motion path based on the determined direction of uncertainty.

### Claim 14 (depends on 13)

The method of claim 13, wherein determining the direction of uncertainty comprises applying a covariance matrix to the three-dimensional ultrasound data.

### Claim 15 (depends on 11)

The method of claim 11, further comprising:
identifying, from the three-dimensional ultrasound data, an image of interest different from the target image and the adjacent image; and
determining the simulated motion path based on the target image, the adjacent image, and the image of interest.

### Claim 16 (depends on 15)

The method of claim 15, further comprising outputting the image of interest in response to receiving the user input.

### Claim 17 (depends on 11)

The method of claim 11, wherein generating the plurality of adjacent images comprises generating a plurality of parallel adjacent images associated with a plurality of parallel adjacent image planes.

### Claim 18 (depends on 11)

The method of claim 11,
wherein generating the target image comprises generating the target image to exclude an anatomical feature, and
wherein generating the adjacent image comprises generating the adjacent image to include the anatomical feature.

### Claim 19 (depends on 11)

The method of claim 11, further comprising:
outputting, to the display, a graphical representation of an adjacent image plane associated with the adjacent image, wherein the graphical representation includes:
a diagrammatic view of a body portion associated with the target image; and
an indicator of the adjacent image plane overlaid on the diagrammatic view of the body portion.