# US 12,594,057 B2 · Apparatus and method for automatic ultrasound segmentation for visualization and measurement

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,594,057 B2
- Document ID: US12594057B2
- Status: Granted
- Kind: B2
- Application number: 18/790,986
- Filed: 2024-07-31
- Published: 2024-11-28
- Granted: 2026-04-07
- Earliest claimed: 2020-03-09
- Assignees: Verdure Imaging, Inc.
- Applicants: Verdure Imaging, Inc.
- Inventors: Christopher Schlenger; Tamas Ungi
- Web page: https://patentgrep.com/patent/US12594057B2

## CPC

- A61B 8/483: {involving the acquisition of a 3D volume of data}
- A61B 8/085: {for locating body or organic structures, e.g. tumours, calculi, blood vessels, nodules}
- A61B 8/4254: {using sensors mounted on the probe}
- A61B 8/4263: {using sensors not mounted on the probe, e.g. mounted on an external reference frame}
- A61B 8/466: {adapted to display 3D data}
- A61B 8/5223: {for extracting a diagnostic or physiological parameter from medical diagnostic data (for algorithms to analyse biomedical images G06T7/0012)}
- A61B 8/5253: {combining overlapping images, e.g. spatial compounding}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

A system and method for performing ultrasound scans is provided. One embodiment of the ultrasonagraphic system acquires sonogram information from a series of ultrasonic scans of a human subject. The series of ultrasound scans are taken over a portion of interest on the human subject which has their underlying bone structure or other ultrasound discernable organ that is under examination. The data from the series of scans are synthesized into a single data file that corresponds to a three-dimensional (3D) image and/or 3D model of the underlying bone structure or organ of the examined human subject.

## Claims

### Claim 1

An ultrasonagraphic method, comprising:
generating, using an ultrasound transducer probe, sonogram image information during each one of a plurality of ultrasound scans of a human subject, wherein at least one optical target is located on the ultrasound transducer probe;
receiving, at an ultrasound image data processor, the sonogram image information from the ultrasound transducer probe;
generating, at the ultrasound image data processor, a plurality of time indexed sonogram images from the received sonogram image information, wherein each time indexed sonogram image includes the corresponding sonogram image information and a time of acquisition of the corresponding sonogram image information;
capturing, using at least one image capture device, a time sequenced series of camera images that include both the human subject and the ultrasound transducer probe, wherein each one of the series of camera images includes a time index that indicates a time of acquisition of the camera image by the at least one image capture device, and wherein each one of the series of camera images includes an image of the at least one optical target on the ultrasound transducer probe;
determining a location of the at least one optical target on the ultrasound transducer probe;
determining time indexed location information for each camera image based on the determined location of the at least one optical target on the ultrasound transducer probe;
generating a plurality of location and time indexed sonogram images based on the each one of the time indexed sonogram images and the corresponding time indexed location information; and
combining the received plurality of location and time indexed sonogram images to generate a composite sonogram image information.

### Claim 2 (depends on 1)

The ultrasonagraphic method of claim 1, further comprising:
generating three dimensional (3D) or two dimensional (2D) composite sonogram graphical information based on the composite sonogram image information.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
generating an image based on the 3D or 2D composite sonogram graphical information,
wherein the image is presentable on a display.

### Claim 4 (depends on 1)

The ultrasonagraphic method of claim 1, further comprising:
wherein the at least one target on the ultrasound transducer probe is the at least one first target on the ultrasound transducer probe,
wherein at least one second target is located on the human subject, and
wherein each one of the series of camera images includes an image of the at least one optical first target on the ultrasound transducer probe and an image of the at least one second target on the human subject.

### Claim 5 (depends on 1)

The ultrasonagraphic method of claim 1, further comprising:
wherein the at least one target on the ultrasound transducer probe is the at least one first target on the ultrasound transducer probe,
wherein at least one second target is located proximate to the human subject, and
wherein each one of the series of camera images includes an image of the at least one optical first target on the ultrasound transducer probe and an image of the at least one second target proximate to the human subject.

### Claim 6 (depends on 1)

The ultrasonagraphic method of claim 1, further comprising:
wherein an identifiable object is located proximate to the human subject, and
wherein each one of the series of camera images includes an image of the at least one optical target on the ultrasound transducer probe and an image of the identifiable object.

### Claim 7 (depends on 1)

The ultrasonagraphic method of claim 1, further comprising:
determining an orientation of the ultrasound transducer probe,
wherein the plurality of generated time indexed sonogram images are based on the corresponding orientation of the ultrasound transducer probe.

### Claim 8

An ultrasonagraphic method, comprising:
generating, using an ultrasound transducer probe, sonogram image information during each one of a plurality of ultrasound scans of a human subject;
receiving, at an ultrasound image data processor, the sonogram image information from the ultrasound transducer probe;
generating, at the ultrasound image data processor, a plurality of time indexed sonogram images that each include the corresponding sonogram image information and a corresponding time of acquisition of the sonogram image information;
determining a location and an orientation of the ultrasound transducer probe during each one of the plurality of ultrasound scans of the human subject;
determining time indexed location information for each one of the plurality of ultrasound scans of the human subject based on the determined location and orientation of the ultrasound transducer probe;
generating a plurality of location and time indexed sonogram images based on the each one of the time indexed sonogram image information portions and the corresponding time indexed location information; and
combining the received plurality of location and time indexed sonogram images to generate a composite sonogram image information.

### Claim 9 (depends on 8)

The ultrasonagraphic method of claim 8, further comprising:
generating three dimensional (3D) 3D or two dimensional (2D) 2D composite sonogram graphical information based on the composite sonogram image information.

### Claim 10 (depends on 9)

The ultrasonagraphic method of claim 9, further comprising:
generating an image based on the 3D or 2D composite sonogram graphical information,
wherein the image is presentable on a display.

### Claim 11 (depends on 8)

The ultrasonagraphic method of claim 8, wherein determining the location and the orientation of the ultrasound transducer probe during each one of the plurality of ultrasound scans of the human subject comprises:
detecting an electromagnetic field using an electromagnetic sensor located on the ultrasound transducer probe,
wherein the electromagnetic field is emitted by an electromagnetic transducer when at a known reference location and orientation, and
wherein the location and the orientation of the ultrasound transducer probe is determined based on the detected electromagnetic field.

### Claim 12

An ultrasonagraphic method, wherein at least one first optical target is located on an ultrasound transducer probe, and wherein at least one second optical target is located on a human subject, the method comprising:
scanning the human subject a plurality of first times during a first time period using the ultrasound transducer probe;
generating ultrasound image information during each one of the plurality of ultrasound scans performed during the first time period;
receiving, at an ultrasound image data processor, each of the plurality of sonogram image information generated during the first time period from the ultrasound transducer probe;
generating, at the ultrasound image data processor, a first plurality of time indexed sonogram images from the received first plurality of sonogram image information, wherein each time indexed sonogram image includes the corresponding sonogram image information and a time of acquisition of the corresponding sonogram image information;
capturing during the first time period, using at least one image capture device, a time sequenced series of first camera images that include both the human subject and the ultrasound transducer probe,
wherein each one of the series of first camera images includes a time index that indicates a time of acquisition of the camera image by the at least one image capture device,
wherein each one of the series of first camera images includes a first image portion of the at least one first optical target on the ultrasound transducer probe, and
wherein each one of the series of first camera images includes a second image portion of the at least one second optical target on the human subject;
for corresponding ones of the series of first camera images having a time index that corresponds to the time of acquisition of one of the first plurality of ultrasound image information, the method further comprising:
determining a first location of the at least one first optical target on the ultrasound transducer probe;
determining a second location of the at least one second optical target on the human subject;
determining time indexed location information for each first camera image based on the determined location of the at least one first optical target and the at least one second optical target, wherein the time indexed location information includes information defining the first location of the at least one first optical target on the ultrasound transducer probe and the second location of the at least one second optical target on the human subject;
generating a first plurality of location and time indexed sonogram images based on the each one of the time indexed sonogram images and the corresponding time indexed location information; and
combining the received first plurality of location and time indexed sonogram images to generate a composite sonogram image information.

### Claim 13 (depends on 12)

The ultrasonagraphic method of claim 12, further comprising:
storing the composite sonogram image information.

### Claim 14 (depends on 13)

The ultrasonagraphic method of claim 13, further comprising:
generating composite sonogram graphical information based on the composite sonogram image information.

### Claim 15 (depends on 14)

The ultrasonagraphic method of claim 14, further comprising:
scanning the human subject a plurality of second times during a second time period using the ultrasound transducer probe, wherein the second time period occurs after the first time period;
generating ultrasound image information during each one of the plurality of ultrasound scans performed during the second time period;
receiving, at an ultrasound image data processor, the second plurality of sonogram image information generated during the second time period from the ultrasound transducer probe;
generating, at the ultrasound image data processor, a second plurality of time indexed sonogram images from the received second plurality of sonogram image information, wherein each time indexed sonogram image includes the corresponding sonogram image information and a time of acquisition of the corresponding sonogram image information;
capturing during the second time period a time sequenced series of second camera images that include both the human subject and the ultrasound transducer probe,
wherein each one of the series of first camera images includes a time index that indicates a time of acquisition of the camera image by the at least one image capture device,
wherein each one of the series of second camera images includes the first image portion of the at least one first optical target on the ultrasound transducer probe, and
wherein each one of the series of second camera images includes the second image portion of the at least one second optical target on the human subject;
for corresponding ones of the series of second camera images having a time index that corresponds to the time index of one of the second plurality of ultrasound image information, the method further comprising:
determining the first location of the at least one first optical target on the ultrasound transducer probe;
determining the second location of the at least one second optical target on the human patient;
determining time indexed location information for each second camera image based on the determined location of the at least one first optical target and the at least one second optical target, wherein the time indexed location information includes information defining the first location of the at least one first optical target on the ultrasound transducer probe and the second location of the at least one second optical target on the human subject;
generating a second plurality of location and time indexed sonogram images based on the each one of the time indexed sonogram images and the corresponding time indexed location information;
retrieving the composite sonogram image information; and
combining the received second plurality of location and time indexed sonogram images into the composite sonogram image information.

### Claim 16 (depends on 15)

The ultrasonagraphic method of claim 15, wherein a location of the at least one second optical target during the first time period is the same location of the at least one optical target on the human subject during the second time period.

### Claim 17 (depends on 16)

The ultrasonagraphic method of claim 16, wherein the composite sonogram image information is first composite sonogram image information, the method further comprising:
generating second composite sonogram graphical information based on the composite sonogram image information that includes the received first and second plurality of location and time indexed sonogram images.

### Claim 18 (depends on 15)

The ultrasonagraphic method of claim 15, further comprising:
storing the composite sonogram image information that includes the received first and second plurality of location and time indexed sonogram images.