Delay in video for language translation
AssigneeAmazon Technologies, Inc.
InventorJay A. Crosley
Life of this patent
Estimating the term…
Abstract
Disclosed are various embodiments for translation of speech in a video messaging application. A segment of streaming video is decoded to separate the visual component from the audio component. The audio component is then converted to text, which may then be translated and converted to a translation output comprising a new language. In response, the translation output may be encoded with the previously separated visual component. A delay is imposed on the visual component to account for any delays that may arise in translation. The translated video may then be streamed to participants giving the appearance of real-time video conferencing.
Claims19
A non-transitory computer-readable medium embodying a program executable in a computing device, the program comprising:
- code that generates a data stream that comprises an audio signal embodying a first language and a video signal;
- code that transmits a first signal to a receiving computing device to turn on a first indicator that indicates an impending data stream;
- code that translates the audio signal embodying the first language into a translation output embodying a second language;
- code that adjusts a play speed of the translation output according to a duration of a video component of the video signal;
- code that imposes a delay in the video signal, the delay depending at least in part upon a time needed to perform a translation;
- code that associates the translation output with the video signal;
- code that determines whether a predefined amount of the audio signal embodying the first language has been translated to the translation output embodying the second language before a transmission to avoid a discontinuity in a plurality of speech segments;
- code that transmits a second signal to the receiving computing device to update a second indicator that displays an estimated accuracy of the translation;
- and
- code that transmits the video signal with the translation output to the receiving computing device responsive to the predefined amount of the audio signal embodying the first language being translated.
A system, comprising:
- at least one computing device;
- and
- a translation application executable in the at least one computing device, the translation application comprising:
- logic that receives a data stream that comprises an audio signal embodying a first language and a video signal from a transmitting computing device;
- logic that translates the audio signal embodying the first language into a translation output embodying a second language;
- logic that imposes a delay in the video signal, the delay depending upon a time needed to perform a translation;
- logic that associates the translation output with the video signal;
- logic that determines whether a predefined amount of the audio signal embodying the first language has been translated to the translation output embodying the second language;
- and
- logic that transmits the video signal with the translation output to a receiving computing device responsive to the predefined amount of the audio signal embodying the first language being translated.
A method, comprising:
- receiving, by at least one computing device, a data stream that comprises an audio signal and a video signal from a transmitting computing device, the audio signal embodying a first language;
- translating, by the at least one computing device, the audio signal embodying the first language into a translation output embodying a second language;
- imposing, by the at least one computing device, a delay in the video signal, the delay depending upon a time needed to perform a translation;
- associating, by the at least one computing device, the translation output with the video signal;
- determining, by the at least one computing device, whether a predefined amount of the audio signal embodying the first language has been translated to the translation output embodying the second language;
- and
- transmitting, by the at least one computing device, the video signal with the translation output to a receiving computing device responsive to the predefined amount of the audio signal embodying the first language being translated.
Dependencies are inferred from the claim text.