Transcription generation

A system comprising:

• one or more computer readable mediums including instructions;
• one or more computing systems coupled to the one or more computer readable mediums and configured to execute the instructions to cause or direct the system to perform operations, the operations comprising:
• obtaining, from a device, audio data of a communication session between the device and another device;
• directing the audio data to an automatic speech recognition system configured to generate transcript data that includes a transcription of the audio data, the generating of the transcript data including:
• extracting features from the audio data to generate a vector of features;
• determining a set of probabilities using the vector of features;
• determining one or more hypothesized words based on the set of probabilities;
• and
• outputting the transcription of the audio data based on the hypothesized words;
• directing the audio data to one or more secondary automatic speech recognition systems each configured to generate secondary transcript data that includes a separate transcription of the audio data, the generating of the secondary transcript data including:
• extracting features from the audio data to generate a vector of features;
• determining a set of probabilities using the vector of features;
• determining one or more hypothesized words based on the set of probabilities;
• and
• outputting the separate transcription of the audio data based on the one or more hypothesized words;
• providing the transcript data from the automatic speech recognition system and the secondary transcript data from the secondary automatic speech recognition systems to a large language model for the large language model to correct errors in at least one of the transcript data or the secondary transcript data;
• in response to providing the transcript data and the secondary transcript data to the large language model, obtaining correction data generated by the large language model using the transcript data and the secondary transcript data, wherein the correction data includes correction of errors in at least one of the transcript data or the secondary transcript data;
• and
• directing, to the device, data based on the correction data.

A method of transcript generation, the method comprising:

• obtaining audio data;
• directing the audio data to an automatic speech recognition system configured to generate transcript data that includes a transcription of the audio data, the generating of the transcript data including:
• extracting features from the audio data to generate a vector of features;
• determining a set of probabilities using the vector of features;
• determining one or more hypothesized words based on the set of probabilities;
• and
• outputting the transcription of the audio data based on the hypothesized words;
• directing the audio data to one or more secondary automatic speech recognition systems each configured to generate secondary transcript data that includes a separate transcription of the audio data, the generating of the secondary transcript data including:
• extracting features from the audio data to generate a vector of features;
• determining a set of probabilities using the vector of features;
• determining one or more hypothesized words based on the set of probabilities;
• and
• outputting the separate transcription of the audio data based on the one or more hypothesized words;
• providing the transcript data from the automatic speech recognition system and the secondary transcript data from the secondary automatic speech recognition systems to a large language model for the large language model to correct errors in at least one of the transcript data or the secondary transcript data;
• in response to providing the transcript data and the secondary transcript data to the large language model, obtaining, correction data generated by the large language model using the transcript data and the secondary transcript data, wherein the correction data includes correction of errors in at least one of the transcript data or the secondary transcript data;
• and
• generating revised transcript data using the correction data.