Transducer-based streaming deliberation for cascaded encoders

A transducer-based deliberation model for cascaded encoders comprising:

• a first encoder configured to:
• receive, as input, a sequence of acoustic frames;
• and
• generate, at each of a plurality of output steps, a first higher order feature representation for a corresponding acoustic frame in the sequence of acoustic frames;
• a first pass transducer decoder configured to:
• receive, as input, the first higher order feature representation generated by the first encoder at each of the plurality of output steps;
• and
• generate, at each of the plurality of output steps, a first pass speech recognition hypothesis for a corresponding first higher order feature representation;
• a text encoder configured to:
• receive, as input, the first pass speech recognition hypothesis generated at each of the plurality of output steps;
• and
• generate, at each of the plurality of output steps, a text encoding for a corresponding first pass speech recognition hypothesis;
• a second encoder configured to:
• receive, as input, the first higher order feature representation generated by the first encoder at each of the plurality of output steps;
• and
• generate, at each of the plurality of output steps, a second higher order feature representation for a corresponding first higher order feature representation;
• and
• a second pass transducer decoder configured to:
• receive, as input, the second higher order feature representation generated by the second encoder at each of the plurality of output steps and the text encoding generated by the text encoder at each of the plurality of output steps;
• and
• generate, at each of the plurality of output steps, a second pass speech recognition hypothesis.