Guiding transcript generation using detected section types as part of automatic speech recognition
AssigneeAmazon Technologies, Inc.
InventorsLei Xu, Aparna Elangovan, Rohit Paturi, Sundararajan Srinivasan, Sravan BAbu Bodapati, Katrin Kirchoff, Sarthak Handa
Life of this patent
Estimating the term…
Abstract
Transcript generation as part of automatic speech recognition may be guided using section types. Audio data is received for transcription. An initial transcript of the audio data may be generated and evaluated to determine a section type for the audio data. The section type may then be used to focus generation of a second version of the transcript on one speaker over another speaker.
Claims20
A system, comprising:
- one or more computing devices, respectively comprising a processor and a memory, that implement an automatic speech recognition system as part of a service of a provider network, wherein the automatic speech recognition system is configured to:
- receive audio data for generating a transcription;
- generate a first version of a transcript for speech in a portion of the audio data according to a machine learning model trained to recognize the speech in the portion of the audio data, wherein the portion of the audio data includes overlapping speech between a first speaker and a second speaker;
- select a section type for the portion of the audio data out of a plurality of possible section types according to an evaluation of the first version of the transcript;
- generate a second version of the transcript for speech in the portion of the audio data according to the section type, wherein the section type causes the generating the second version of the transcript to bias speech recognition in favor of the first speaker in the portion of the audio data over the second speaker in the portion of the audio data;
- and
- provide the second version of the transcript for speech in the portion of the audio data.
A method, comprising:
- receiving, at an automatic speech recognition system, audio data for generating a transcription;
- generating, by the automatic speech recognition system, a first version of a transcript for speech in a portion of the audio data;
- detecting, by the automatic speech recognition system, a section type for the portion of the audio data according to an evaluation of the first version of the transcript;
- generating, by the automatic speech recognition system, a second version of the transcript for speech in the portion of the audio data according to the section type, wherein the section type causes the automatic speech recognition system to bias speech recognition in favor of a first speaker in the portion of the audio data over a second speaker in the portion of the audio data;
- and
- providing, by the automatic speech recognition system, the second version of the transcript for speech in the portion of the audio data.
One or more non-transitory, computer-readable storage media, storing program instructions that when executed on or across one or more computing devices cause the one or more computing devices to implement:
- receiving audio data for generating a transcription;
- generating a first version of a transcript for speech in a portion of the audio data according to a machine learning model trained to recognize the speech in the portion of the audio data;
- detecting a section type for the portion of the audio data according to an evaluation of the first version of the transcript;
- generating a second version of the transcript for speech in the portion of the audio data according to the section type, wherein the section type causes the generating the second version of the transcript to bias speech recognition in favor of a first speaker in the portion of the audio data over a second speaker in the portion of the audio data;
- and
- providing the second version of the transcript for speech in the portion of the audio data.
Dependencies are inferred from the claim text.