Generation and detection of watermark for real-time voice conversion

A system comprising:

• an adversarial neural network configured to train a generative neural network to generate synthetic speech in a target voice;
• a watermark network configured to train the generative neural network to generate the synthetic speech including a watermark that is detectable by the watermark network,
• the adversarial neural network further configured to train the generative neural network to generate the synthetic speech in a target voice, the synthetic speech including the watermark;
• and
• the generative neural network configured to generate the synthetic speech including the watermark in the target voice.

A computer program product for use on a computer system for training a system to generate a speech watermark, the computer program product comprising a tangible, non-transient computer usable medium having computer readable program code thereon, the computer readable program code comprising:

• code for generating, using a generator, speech data including a watermark, wherein the generator is trained to produce speech data including the watermark,
• code for training the generator comprising:
• code for generating first speech data configured to represent human speech, the first speech data including a candidate watermark;
• code for producing an inconsistency message relating to at least one difference between the first speech data and realistic human speech;
• code for transforming the first speech data, including the candidate watermark using a watermark robustness module to produce transformed first speech data including a transformed candidate watermark,
• the transformed first speech data (1) configured to be detectable as realistic speech, and (2) including a transformed candidate watermark configured to be detectable by a watermark machine learning system;
• code for detecting the transformed candidate watermark, using a watermark detection machine learning system;
• and
• code for producing a watermark-detectability message relating to the transformed candidate watermark.