Synchronization method for visual information and auditory information and information processing device

An information processing device, comprising:

• a memory coupled to a processor, the memory storing instructions that when executed by the processor, configure the processor to:
• input input image data including first visual information as well as input speech data in a first language that includes first auditory information, the first visual information including a first gesture and a second gesture occurring after the first gesture,
• output output visual data including second visual information corresponding to the first visual information, as well as output speech data in a second language that includes second auditory information corresponding to the first auditory information,
• detect the first visual information from the input image data,
• recognize the first auditory information from the input speech data,
• associate the first visual information with the first auditory information,
• convert the input speech data in the first language into the output speech data in the second language, and
• control the output timing of the second visual information and the second auditory information so as to reduce the output timing difference between the second visual information and the second auditory information, both of which correspond to the first visual information and the first auditory information that are associated with each other,
• wherein the optimization unit includes an image editing unit for editing output image data which is the output visual data so that the second gesture occurs before the first gesture.