Multi-encoder end-to-end automatic speech recognition (asr) for joint modeling of multiple input devices

A computer-implemented method of operating an automatic speech recognition (ASR) system, comprising:

• providing a first encoder configured for close-talk input captured by a close-talk input mechanism;
• providing a second encoder configured for far-talk input captured by a far-talk input mechanism;
• and
• providing an encoder selection layer configured to select the first encoder, the second encoder, or both, based on a first speech feature derived from the close-talk input, a second speech feature derived from the far-talk input, or both,
• wherein upon determining that signals from both the close-talk input mechanism and the far-talk input mechanism are present for a speech segment:
• the first encoder processes the first speech feature derived from the close-talk input to produce a first output, and the second encoder processes the second speech feature derived from the far-talk input to produce a second output;
• and
• the first output of the first encoder and the second output of the second encoder are weighted according to encoder-selection probabilities to produce a combined output.