Generating speaker video and audio in multiple languages for videoconferencing
AssigneeZoom Video Communications, Inc.
InventorsYuhui Chen, Qiang Gao, Zhaofeng Jia
Life of this patent
Estimating the term…
Loading patent…
AssigneeZoom Video Communications, Inc.
InventorsYuhui Chen, Qiang Gao, Zhaofeng Jia
Estimating the term…
Systems and methods for generating speaker video and audio in multiple languages for videoconferencing are provided. For example, a computing device can access a speaker speech audio signal that includes a speaker speech in a first language, a video of the speaker and a translated speech audio signal of the speaker speech in a second language. The computing device generates, based on the translated speech audio signal, a converted translated speech audio signal that includes a speech in the second language having voice characteristics in the speaker speech. The computing device further generates a lip-synched speaker video based on the video of the speaker and the converted translated speech audio signal. Lip movements in the lip-synched speaker video correspond to the converted translated speech audio signal. The converted translated speech audio signal and the lip-synched speaker video are transmitted to a video conference provider configured to host the video conference.
A method performed by a computing device, the method comprising:
A computing device, comprising:
A non-transitory computer-readable medium comprising processor-executable instructions configured to cause one or more processors to:
Dependencies are inferred from the claim text.