Artificial intelligence captions using an ensemble method for audio tempo and pitch

A computer system for generating captions, the computer system comprising:

• one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:
• capturing input audio comprising audiovisual content;
• processing the input audio to extract an input rate of speech, a plurality of input word timings, and a plurality of input word predictions;
• generating one or more new audio files by altering the input rate of speech of the input audio to fall within a pre-determined range;
• processing the one or more new audio files to extract a plurality of new word timings and a plurality of new word predictions;
• creating a mapping that pairs the plurality of input word timings with corresponding new word timings of the plurality of new word timings;
• selecting a word prediction for each paired input word timing and new word timing based on the mapping;
• and
• integrating the selected word predictions into the audiovisual content for display.

A computer program product for generating captions, the computer program product comprising:

• one or more computer-readable tangible storage medium and program instructions stored on at least one of the one or more tangible storage medium, the program instructions executable by a processor to cause the processor to perform a method comprising:
• capturing input audio comprising audiovisual content;
• processing the input audio to extract an input rate of speech, a plurality of input word timings, and a plurality of input word predictions;
• generating one or more new audio files by altering the input rate of speech of the input audio to fall within a pre-determined range;
• processing the one or more new audio files to extract a plurality of new word timings and a plurality of new word predictions;
• creating a mapping that pairs the plurality of input word timings with corresponding new word timings of the plurality of new word timings;
• selecting a word prediction for each paired input word timing and new word timing based on the mapping;
• and
• integrating the selected word predictions into the audiovisual content for display.