Visualizing automatic speech recognition and machine translation output

An automated speech processing system comprising:

• one or more processing units configured to operate as:
• a speech-to-text (STT) engine for receiving an audio input and for converting the audio input to text data in a source language;
• a machine translation (MT) engine for receiving the text data from the STT engine and for translating the text data to text data in a target language;
• and
• a caption engine for rendering the text data in the target language on a display device, and for applying different visualization schemes based on color, font, size, underlining and italicization to different parts of the rendered text data based on defined characteristics of metadata received from the STT engine and the MT engine identifying defined characteristics of specific portions of the rendered text data in the target language including a defined confidence value representing the accuracy of the rendered text data based on both the accuracy of the converting the audio input to text data in the source language and the accuracy of translating the text data including interactions between the STT engine and MT engine comprising alignment information, and determining specific portions of the text data in the target language to which said defined characteristics, identified by the metadata from the STT engine, apply.

An article of manufacture comprising:

• at least one tangible computer readable medium device having computer readable program code logic tangibly embodied therein to execute machine instructions in one or more processing units for processing speech, said computer readable program code logic, when executing, performing the following:
• receiving an audio input at a speech-to-text (STT) engine and converting the audio input to text data in a source language;
• translating the text data, using a machine translation (MT) engine, to text data in a target language;
• rendering the text data in the target language on a display device, including receiving metadata from the STT engine and the MT engine identifying defined characteristics of specific portions of the rendered text data in the target language including a defined confidence value representing the accuracy of the rendered text data based on both the accuracy of the converting the audio input to text data in the source language and the accuracy of translating the text data including interactions between the STT engine and MT engine comprising alignment information, and determining specific portions of the text data in the target language to which said defined characteristics, identified by the metadata from the STT engine, apply;
• and
• applying different visualization schemes based on color, font, size, underlining and italicizing to different parts of the rendered text data based on the defined characteristics of the metadata.