Multilingual multimedia translation with synchronized audio and body gestures

A method comprising:

• accessing a multimedia asset depicting an individual from a first culture;
• identifying a first gesture made by the individual in the multimedia asset;
• determining a second gesture in a second culture having a meaning that matches the meaning of the first gesture in the first culture, wherein the first and second gestures are different;
• and
• adding the second gesture to the multimedia asset to modify the multimedia asset to reflect the second culture.

A system comprising:

• one or more computer processors;
• and
• a memory containing a program which when executed by the computer processors performs an operation comprising:
• accessing a multimedia asset depicting an individual speaking in a first language of a plurality of languages;
• extracting an audio segment of the individual speaking in the multimedia asset;
• identifying a first gesture depicted in the multimedia asset during a first portion of the audio segment;
• determining a first temporal alignment between an utterance made in the first portion of the audio segment and the first gesture;
• and
• generating a synchronized multimedia asset based on at least one of:
• modifying a temporal location of the first gesture in the multimedia asset or modifying a timing of a translated audio segment to set a second temporal alignment between the first gesture and a translation of the utterance in the translated audio segment.