Back to results
US 12,425,781 B2Granted
Mobile device that provides sound enhancement for hearing device
AssigneeStarkey Laboratories, Inc.
InventorsTao Zhang, Daniel Marquardt
Life of this patent
Estimating the term…
Abstract
A system includes a mobile device that receives an audio signal from a microphone of the mobile device. The mobile device processes the audio signal via a neural network to obtain a speech-enhanced audio signal. The system includes an ear-wearable device comprising a data interface operable to communicate with the external data interface of the mobile device. The ear-wearable device includes an audio processing path coupled to the data interface and is operable to receive the speech-enhanced audio signal and reproduce the speech-enhanced audio in an ear of a user.
Claims18
A system, comprising:
- a mobile device, comprising:
- a microphone;
- an external data interface;
- and
- a processor coupled to the microphone and the external data interface, the processor configured with instructions to receive an audio signal from the microphone and process the audio signal via a neural network to obtain a speech-enhanced audio signal;
- and
- an ear-wearable device comprising:
- a data interface operable to communicate with the external data interface of the mobile device;
- a sensor configured to detect speech of a user;
- and
- an audio processing path coupled to the data interface, the ear-wearable device being operable to:
- send a suppression signal to the mobile device via the data interface in response to detecting the speech, the mobile device modifying the speech-enhanced audio signal to reduce interference of the speech with the speech-enhanced audio signal in response to the suppression signal;
- and
- receive the speech-enhanced audio signal and reproduce the speech-enhanced audio in an ear of a user.
11 more elements
A system, comprising:
- a mobile device, comprising:
- a microphone;
- an external data interface;
- and
- a processor coupled to the microphone and the external data interface, the processor configured with instructions to receive an audio signal from the microphone and process the audio signal via a neural network to obtain a speech-enhanced audio signal, wherein processing the audio signal via the neural network to obtain the speech-enhanced audio signal comprises:
- transforming the audio signal from a time domain signal to a frequency domain signal;
- mapping features of the frequency domain signal to an input layer of the neural network;
- producing a ratio mask from the neural network and apply the ratio mask to the frequency domain signal;
- and
- inverse-transforming the masked frequency domain signal to a time domain to obtain the speech-enhanced signal;
- and
- an ear-wearable device comprising a data interface operable to communicate with the external data interface of the mobile device, the ear-wearable device comprising an audio processing path coupled to the data interface and operable to receive the speech-enhanced audio signal and reproduce the speech-enhanced audio in an ear of a user.
9 more elements
A method, comprising:
- receiving an audio signal from a microphone of a mobile device;
- processing the audio signal via a neural network operable on a processor of the mobile device to obtain a speech-enhanced audio signal;
- sending the speech-enhanced audio signal to a data interface of an ear-wearable device;
- detecting speech of a user via a sensor of the ear-wearable device;
- sending from the ear-wearable device to the mobile device a suppression signal in response to detecting the speech;
- modifying the speech-enhanced audio signal via the mobile device to reduce interference of the speech with the speech-enhanced audio signal in response to the suppression signal;
- and
- reproducing the speech-enhanced audio in an ear of a user via an audio processing path of the ear-wearable device.
5 more elements
Dependencies are inferred from the claim text.