System and method for secure data augmentation for speech processing systems

A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a system, cause the system to perform the following operations:

• receiving an input speech signal;
• receiving a transcription of the input speech signal;
• extracting a speaker embedding from the input speech signal;
• extracting acoustic properties from the input speech signal;
• generating an obscured transcription from the transcription, wherein the obscured transcription includes obscured representations of sensitive content from the transcription;
• generating an obscured speech signal based upon, at least in part, the extracted speaker embedding and the obscured transcription, wherein the obscured speech signal includes obscured representations of sensitive content from the input speech signal;
• generating a synthetic speech signal from the obscured speech signal using a synthetic speaker embedding;
• and
• augmenting the synthetic speech signal based upon, at least in part, the extracted acoustic properties.

A system comprising:

• a processor;
• and
• a memory storing programming instructions for execution by the processor, the programming instructions, upon execution by the processor, causing the system to perform the following operations:
• receiving an input speech signal;
• receiving a transcription of the input speech signal;
• extracting a speaker embedding from the input speech signal;
• extracting acoustic properties from the input speech signal;
• generating an obscured transcription from the transcription, wherein the obscured transcription includes obscured representations of sensitive content from the transcription;
• generating an obscured speech signal based upon, at least in part, the extracted speaker embedding and the obscured transcription, wherein the obscured speech signal includes obscured representations of sensitive content from the input speech signal;
• generating a synthetic speech signal from the obscured speech signal using a synthetic speaker embedding;
• and
• augmenting the synthetic speech signal based upon, at least in part, the extracted acoustic properties.