Multi-microphone speech separation
AssigneeMicrosoft Technology Licensing, LLC
InventorsZhuo Chen, Hakan Erdogan, Takuya Yoshioka, Fileno A. Alleva, Xiong Xiao
Life of this patent
Estimating the term…
Abstract
This document relates to separation of audio signals into speaker-specific signals. One example obtains features reflecting mixed speech signals captured by multiple microphones. The features can be input a neural network and masks can be obtained from the neural network. The masks can be applied one or more of the mixed speech signals captured by one or more of the microphones to obtain two or more separate speaker-specific speech signals, which can then be output.
Claims21
A method performed on a computing device, the method comprising:
- obtaining features reflecting mixed speech signals captured by multiple microphones;
- inputting the features to a neural network;
- obtaining masks output by the neural network;
- applying the masks to at least one of the mixed speech signals captured by at least one of the microphones to obtain two or more separate speaker-specific speech signals;
- gain adjusting the two or more separate speaker-specific speech signals;
- and
- outputting the two or more separate speaker-specific speech signals after the gain adjusting.
A system comprising:
- a hardware processing unit;
- and
- a storage resource storing computer-readable instructions which, when executed by the hardware processing unit, cause the hardware processing unit to:
- obtain features reflecting multiple mixed speech signals captured by multiple microphones;
- normalize the features to obtain normalized features;
- input the normalized features to a speech separation model;
- obtain, from the speech separation model, respective masks for individual speakers;
- and
- apply the respective masks to at least one of the mixed speech signals to obtain at least two separate speaker-specific speech signals for different speakers.
A method comprising:
- obtaining features reflecting multiple mixed speech signals captured by multiple microphones;
- normalizing the features to obtain normalized features;
- inputting the normalized features to a speech separation model;
- obtaining, from the speech separation model, respective masks for individual speakers;
- and
- applying the respective masks to at least one of the mixed speech signals to obtain at least two separate speaker-specific speech signals for different speakers.
Dependencies are inferred from the claim text.