Back to results
US 12,676,137 B2Granted
System and method for multi-channel speech privacy processing
AssigneeMicrosoft Technology Licensing, LLC
InventorDushyant Sharma
Life of this patent
Estimating the term…
Abstract
A method, computer program product, and computing system for receiving a speech signal from a single microphone. A sensitive speech component is identified from the speech signal. In response to identifying the sensitive speech component, a filtered speech signal is generated by removing the sensitive speech component from the speech signal. A voice style transfer of the speech signal is generated. Speech processing is performed on the filtered speech signal and the voice style transfer of the speech signal.
Claims19
A method comprising:
- receiving, by a speech processing system, an original speech signal recorded by a single microphone, the original speech signal containing voice characteristics of a user;
- filtering the original speech signal to obtain a filtered speech signal that excludes the voice characteristics of the user;
- performing voice conversion on the original speech signal to obtain a licensed voice signal containing voice characteristics of a licensed user, the voice characteristics of the user being excluded from the filtered speech signal, wherein the filtered speech signal and the licensed voice signal form a multi-channel input;
- generating a single-channel representation of the multi-channel input by combining frames of the filtered speech signal with corresponding frames of the licensed voice signal in a weighted manner such that at least some frames of the filtered speech signal are assigned different weights;
- and
- performing, via an automatic speech recognition (ASR) model, speech recognition on the single-channel representation of the multi-channel input to generate a transcript of the original speech signal.
3 more elements
A computing system comprising:
- a processor;
- and
- a memory storing programming instructions for execution by the processor, the programming instructions, upon execution by the processor, causing the computing system to perform the following operations:
- receiving, by a speech processing system, an original speech signal recorded by a single microphone, the original speech signal containing voice characteristics of a user;
- filtering the original speech signal to obtain a filtered speech signal that excludes the voice characteristics of the user;
- performing voice conversion on the original speech signal to obtain a licensed voice signal containing voice characteristics of a licensed user, the voice characteristics of the user being excluded from the filtered speech signal, wherein the filtered speech signal and the licensed voice signal form a multi-channel input;
- generating a single-channel representation of the multi-channel input by combining frames of the filtered speech signal with corresponding frames of the licensed voice signal in a weighted manner such that at least some frames of the filtered speech signal are assigned different weights;
- and
- performing, via an automatic speech recognition (ASR) model, speech recognition on the single-channel representation of the multi-channel input to generate a transcript of the original speech signal.
6 more elements
A method comprising:
- receiving, by a speech processing system, an original speech signal recorded by a single microphone, the original speech signal containing voice characteristics of a user;
- filtering the original speech signal to obtain a filtered speech signal that excludes the voice characteristics of the user;
- performing voice conversion on the original speech signal to obtain a licensed voice signal containing voice characteristics of a licensed user, the voice characteristics of the user being excluded from the filtered speech signal, wherein the filtered speech signal and the licensed voice signal form a multi-channel input;
- generating a single-channel representation of the multi-channel input by combining bins of the filtered speech signal with corresponding bins of the licensed voice signal in a weighted manner such that at least some of the bins of the filtered speech signal are assigned different weights;
- and
- performing, via an automatic speech recognition (ASR) model, speech recognition on the single-channel representation of the multi-channel input to generate a transcript of the original speech signal.
3 more elements
Dependencies are inferred from the claim text.