# US 2021/0330296 A1 · Methods and apparatuses for enhancing ultrasound data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0330296 A1
- Document ID: US20210330296A1
- Status: Published application
- Kind: A1
- Application number: 17/240,994
- Filed: 2021-04-26
- Published: 2021-10-28
- Earliest claimed: 2020-04-27
- Assignees: Butterfly Network, Inc.
- Inventors: Nathan Silberman; Igor Lovchinsky; Swaminathan Sankaranarayanan; Yang Liu
- Web page: https://patentgrep.com/patent/US20210330296A1

## CPC

- A61B 8/5223: {for extracting a diagnostic or physiological parameter from medical diagnostic data (for algorithms to analyse biomedical images G06T7/0012)}
- A61B 8/466: {adapted to display 3D data}
- G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0475: Generative networks
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G06N 3/094: Adversarial learning
- G06N 20/00: Machine learning
- A61B 8/0866: {involving foetal diagnosis; pre-natal or peri-natal diagnosis of the baby}
- A61B 8/0883: {for diagnosis of the heart}
- A61B 8/4427: {Device being portable or laptop-like}
- A61B 8/4472: {Wireless probes}
- A61B 8/465: {adapted to display user selection data, e.g. icons or menus}
- A61B 8/469: {for selection of a region of interest}
- A61B 8/5269: {involving detection or reduction of artifacts}
- A61B 8/565: {involving data transmission via a network}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Aspects of the technology described herein relate to enhancing ultrasound data. Some embodiments include receiving ultrasound data and automatically determining, with a processing device, that the ultrasound data depicts an anatomical view or one of a set of anatomical views. Based on automatically determining that the ultrasound data depicts the anatomical view or one of the set of anatomical views, an option is enabled to perform ultrasound data enhancement specific to the anatomical view or the set of anatomical views. Based on receiving the selection of the option, the ultrasound data, a portion thereof, and/or subsequently-collected ultrasound data is enhanced using the ultrasound data enhancement specific to the anatomical view or the set of anatomical views.

## Claims

### Claim 1

An apparatus, comprising:
a processing device configured to:
receive ultrasound data;
automatically determine that the ultrasound data depicts an anatomical view or one of a set of anatomical views;
based on automatically determining that the ultrasound data depicts the anatomical view or one of the set of anatomical views, enable an option to perform ultrasound data enhancement specific to the anatomical view or the set of anatomical views;
receive a selection of the option; and
based on receiving the selection of the option, enhance the ultrasound data, a portion thereof, and/or subsequently-collected ultrasound data using the ultrasound data enhancement specific to the anatomical view or the set of anatomical views.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the processing device is in operative communication with an ultrasound device, and the processing device is configured, when receiving the ultrasound data, to receive the ultrasound data from the ultrasound device in real-time as the ultrasound data is collected or generated by the ultrasound device.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the processing device is configured, when receiving the ultrasound data, to retrieve ultrasound data that has been previously stored.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the processing device is configured, when automatically determining that the ultrasound data depicts the anatomical view or one of the set of anatomical views, to use one or more statistical models and/or deep learning techniques.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the anatomical view comprises one of an apical two chamber view of a heart, an apical four chamber view of the heart, a parasternal long axis view of the heart, and a parasternal short axis view of the heart.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the set of anatomical views comprises an apical two chamber view of a heart, an apical four chamber view of the heart, a parasternal long axis view of the heart, and a parasternal short axis view of the heart.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the anatomical view comprises a three-dimensional view of a fetus.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the processing device is configured, when enabling the option, to enable a user to select the option.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the processing device is configured, when enabling the option, to enable an action to be performed upon selection of the option.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the processing device is configured, when enabling the option, to display an option that was not previously displayed by the processing device.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the processing device is configured, when enabling the option, to change a manner of display of the option.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein the processing device is configured, when enhancing the ultrasound data, the portion thereof, and/or the subsequently-collected ultrasound data, to use a statistical model trained to convert ultrasound data from an initial domain to a final domain, where the initial domain includes low-quality ultrasound data and the final domain includes high-quality ultrasound data.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the statistical model is specifically trained on ultrasound data depicting the anatomical view or the set of anatomical views.

### Claim 14 (depends on 1)

The apparatus of claim 1, wherein the processing device is configured, when enhancing the ultrasound data, the portion thereof, and/or the subsequently-collected ultrasound data, to enhance the ultrasound data using a user-selectable degree of enhancement.

### Claim 15 (depends on 1)

The apparatus of claim 1, wherein the processing device is configured, when enhancing the ultrasound data, the portion thereof, and/or the subsequently-collected ultrasound data, to enhance portions of the ultrasound data non-uniformly.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the processing device is configured, when enhancing the portions of the ultrasound data non-uniformly, to enhance first portions of an ultrasound image more than second portions of the ultrasound image, the first portions being closer to a user-selected point than the second portions.

### Claim 17 (depends on 1)

The apparatus of claim 1, wherein the processing device is configured, when enhancing the ultrasound data, the portion thereof, and/or the subsequently-collected ultrasound data, to only enhance a portion of the ultrasound data.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein the processing device is configured, when only enhancing the portion of the ultrasound data, to only enhance a portion of an ultrasound image within a user-selectable region.

### Claim 19

A method, comprising:
receiving ultrasound data;
automatically determining, with a processing device, that the ultrasound data depicts an anatomical view or one of a set of anatomical views;
based on automatically determining that the ultrasound data depicts the anatomical view or one of the set of anatomical views, enabling an option to perform ultrasound data enhancement specific to the anatomical view or the set of anatomical views;
receiving a selection of the option; and
based on receiving the selection of the option, enhancing the ultrasound data, a portion thereof, and/or subsequently-collected ultrasound data using the ultrasound data enhancement specific to the anatomical view or the set of anatomical views.

### Claim 20

At least one non-transitory computer-readable storage medium storing processor-executable instructions that, when executed by at least one processor on a processing device in operative communication with an ultrasound device, cause the at least one processor to:
receive ultrasound data;
automatically determine that the ultrasound data depicts an anatomical view or one of a set of anatomical views;
based on automatically determining that the ultrasound data depicts the anatomical view or one of the set of anatomical views, enable an option to perform ultrasound data enhancement specific to the anatomical view or the set of anatomical views;
receive a selection of the option; and
based on receiving the selection of the option, enhance the ultrasound data, a portion thereof, and/or subsequently-collected ultrasound data using the ultrasound data enhancement specific to the anatomical view or the set of anatomical views.
