Back to results
US 11,887,578 B2Granted
Automatic dubbing method and apparatus
AssigneeMicrosoft Technology Licensing, LLC
InventorsHenry Gabryjelski, Jian Luan, Dapeng Li
Life of this patent
Estimating the term…
Abstract
A method and system for automatic dubbing method is disclosed, comprising, responsive to receiving a selection of media content for playback on a user device by a user of the user device, processing extracted speeches of a first voice from the media content to generate replacement speeches using a set of phenomes of a second voice of the user of the user device, and replacing the extracted speeches of the first voice with the generated replacement speeches in the audio portion of the media content for playback on the user device.
Claims20
An automatic dubbing method, comprising:
- extracting speeches of a first voice from an audio portion of a media content;
- receiving an audio input of a second voice of a user of a user device;
- after receiving the audio input of the second voice of the user of the user device, generating a voice print model for the second voice including a set of phonemes of the second voice using the received audio input;
- receiving a selection of the media content for playback on the user device by the user of the user device;
- and
- responsive to receiving the selection of the media content for playback on the user device:
- processing the extracted speeches of the first voice by utilizing the voice print model to generate replacement speeches, the replacement speeches generated using the set of phonemes of the second voice;
- replacing the extracted speeches of the first voice with the generated replacement speeches in the audio portion of the media content;
- and
- outputting the audio portion with the generated replacement speeches for playback on the user device.
7 more elements
An automatic dubbing apparatus, comprising:
- a speech extracting module configured to extract speeches of a first voice from an audio portion of a media content, receive an audio input of a second voice of a user of a user device, and to extract speeches of the second voice from the audio input;
- a voice print model obtaining module configured to generate, after receiving the audio input of the second voice of the user of the user device, a voice print model for the extracted speeches of the second voice including a set of phonemes of the second voice;
- and
- a speech processing module configured to, responsive to receiving a selection of the media content for playback on the user device by the user of the user device:
- process the extracted speeches of the first voice by utilizing the voice print model to generate replacement speeches, the replacement speeches generated using the set of phonemes of the second voice;
- replace the extracted speeches of the first voice with the generated replacement speeches in the audio portion of the media content;
- and
- output the audio portion with the generated replacement speeches for playback on the user device.
5 more elements
A computer system, comprising:
- one or more processors;
- and
- a memory storing computer-executable instructions that, when executed, cause the one or more processors to:
- extract speeches of a first voice from an audio portion of a media content;
- receive an audio input of a second voice of a user of a user device;
- after receiving the audio input of the second voice of the user of the user device generate a voice print model for the second voice including a set of phonemes of the second voice using the received audio input of the second voice of the user of the user device;
- receive a selection of the media content for playback on the user device by the user of the user device;
- and
- responsive to receiving the selection of the media content for playback:
- process the extracted speeches of the first voice by utilizing the voice print model to generate replacement speeches, the replacement speeches generated using the set of phonemes of the second voice;
- replace the extracted speeches of the first voice with the generated replacement speeches in the audio portion of the media content;
- and
- output the audio portion with the generated replacement speeches for playback on the user device.
10 more elements
Dependencies are inferred from the claim text.