System and method for optimized audio mixing

A system comprising:

• at least one microphone configured to capture a plurality of audio signals from one or more audio sources and provide each of the plurality of audio signals to a respective one of a plurality of audio channels;
• a detector communicatively couped to the at least one microphone and configured to determine a respective speech quality for each of the plurality of audio signals;
• a selector communicatively coupled to the at least one microphone and the detector, the selector configured to identify, in real time, a first subset of the plurality of audio channels as capturing speech audio based on the respective speech quality for each of the plurality of audio signals, wherein the first subset comprising one or more audio channels from the plurality of audio channels, and identifying, in real time, a second subset of the plurality of audio channels as capturing noise audio based on the respective speech quality for each of the plurality of audio signals, wherein the second subset comprises one or more other audio channels from the plurality of audio channels;
• a first mixer configured to generate a mixed audio output using the audio signals received at the one or more audio channels in the first subset;
• a second mixer configured to generate a noise mix using the audio signals received at the one or more other audio channels in the second subset;
• and
• a source remover configured to remove off-axis noise from the mixed audio output by applying, to the mixed audio output, a mask determined based on the noise mix.

A non-transitory computer-readable medium comprising instructions that, when executed by at least one processor, cause the at least one processor to perform:

• receiving, at each of a plurality of audio channels, a respective one of a plurality of audio signals captured by one or more microphones;
• determining a respective speech quality for each of the plurality of audio channels;
• identifying, in real time, a first subset of the plurality of audio channels as capturing speech audio based on the respective speech quality for each of the plurality of audio signals, wherein the first subset comprises one or more audio channels from the plurality of audio channels, and
• identifying, in real time, a second subset of the plurality of audio channels as capturing noise audio based on the respective speech quality for each of the plurality of audio signals, wherein the second subset comprises one or more other audio channels from the plurality of audio channels;
• generating, using a first mixer, a mixed audio output that includes the audio signals received at the one or more audio channels in the first subset;
• generating, using a second mixer, a noise mix that includes the audio signals received at the one or more other audio channels in the second subset;
• and
• removing off-axis noise from the mixed audio output by applying, to the mixed audio output, a mask determined based on the noise mix.