Multi-sensory speech enhancement using synthesized sensor signal
AssigneeMicrosoft Corporation
InventorsLi Deng, Zhengyou Zhang, Zicheng Liu, Amarnag Subramanya
Life of this patent
Estimating the term…
Abstract
A synthesized alternative sensor signal is produced from an alternative sensor signal. The synthesized alternative sensor signal is computed using vocal tract resonances estimated based on the alternative sensor signal, and using a waveform synthesis technique that converts the estimated vocal tract resonance sequence into a spectral magnitude sequence. The synthesized alternative sensor signal and the alternative sensor signal are used to estimate a clean speech value.
Claims20
A method of determining an estimate for a noise-reduced value representing a portion of a noise-reduced speech signal, the method comprising:
- generating an alternative sensor signal using an alternative sensor;
- forming a synthesized alternative sensor signal based on the alternative sensor signal;
- and
- using the alternative sensor signal, and the synthesized alternative sensor signal to form an estimate of the noise-reduced value.
A computer-readable medium having computer-executable instructions for performing steps comprising:
- receiving a sensor signal representing speech;
- identifying vocal tract resonances in the sensor signal;
- converting the identified vocal tract resonances into a synthesized sensor signal;
- and
- using the synthesized sensor signal to identify a clean speech value.
A method of identifying a clean speech value for a clean speech signal, the method comprising:
- receiving an air-conduction microphone signal;
- receiving an alternative sensor signal;
- forming a synthesized alternative sensor signal;
- and
- using the air-conduction microphone signal, the alternative sensor signal and the synthesized alternative sensor signal to estimate the clean speech value.
Dependencies are inferred from the claim text.