Automated voice translation dubbing for prerecorded video

A machine-readable storage medium storing instructions which, when executed, cause a processing device to perform operations comprising:

• identifying original caption data for a video, wherein the original caption data comprises a plurality of caption character strings associated with audio portion of the video;
• identifying speech recognition data generated for the audio portion of the video, the speech recognition data comprising a plurality of generated character strings and associated timing information for each generated character string;
• mapping the plurality of caption character strings to the plurality of generated character strings using assigned values indicative of semantic similarities between individual caption character strings of the plurality of caption character strings and individual generated character strings of the plurality of generated character strings;
• assigning timing information to the individual caption character strings based on timing information of mapped individual generated character strings;
• and
• aligning a translation of the original caption data with the audio portion of the video using the assigned timing information of the individual caption character strings.

A system comprising:

• a memory;
• and
• a processing device operatively coupled with the memory to:
• identify original caption data for a video, wherein the original caption data comprises a plurality of caption character strings associated with audio portion of the video;
• identify speech recognition data generated for the audio portion of the video, the speech recognition data comprising a plurality of generated character strings and associated timing information for each generated character string;
• map the plurality of caption character strings to the plurality of generated character strings using assigned values indicative of semantic similarities between individual caption character strings of the plurality of caption character strings and individual generated character strings of the plurality of generated character strings;
• assign timing information to the individual caption character strings based on timing information of mapped individual generated character strings;
• and
• align a translation of the original caption data with the audio portion of the video using the assigned timing information of the individual caption character strings.