Code-mixed speech engine in a speech synthesis system

One or more computer-storage media having computer-executable instructions embodied thereon that, when executed by a computing system having a processor and memory, cause the processor to perform operations, the operations comprising:

• communicating a request for synthesized speech, the request being associated with code-mixed input of a speech synthesis client;
• based on the request, receiving an instance of code-mixed synthesized speech in a single target speaker voice across two or more languages, the code-mixed synthesized speech is generated using a code-mixed speech model that is associated with a training engine and an inference engine that support generating code-mixed synthesized speech,
• wherein the code-mixed speech model is trained using an orthogonal loss training constraint that separates speaker embeddings and language embeddings to reduce accent leakage;
• and
• causing output of the instance of code-mixed synthesized speech associated with the single target speaker voice via an interface associated with the speech synthesis client.

A computer-implemented method, the method comprising:

• accessing code-mixed training data associated with a plurality of different languages;
• based on the code-mixed training data, generating a code-mixed speech model associated with a training engine and an inference engine that support generating code-mixed synthesized speech in a single target speaker voice across two or more languages,
• wherein the code-mixed speech model is trained using an orthogonal loss training constraint that separates speaker embeddings and language embeddings to reduce accent leakage;
• and
• deploying the code-mixed speech model to cause generation of an instance of code-mixed synthesized speech in a single target speaker voice across two or more languages using the code-mixed speech model and the inference engine, generating.