Audio processing in multi-speaker multi-channel audio environments

A system comprising:

• one or more processing units to:
• receive a first set of audio data channels (ADCs) jointly capturing a speech produced by one or more speakers;
• obtain, using the first set of ADCs, a second set of ADCs, individual ADCs of the second set of ADCs representing one or more channels of the first set of ADCs, at least one channel of the second set of ADCs representing a cluster of two or more ADCs of the first set of ADCs, the two of more ADCs being selected based at least on a similarity of audio data of the two or more ADCs;
• and
• process, using an audio processing neural network (NN) model, the second set of ADCs to obtain an association of the speech to the one or more speakers.

A processing device to:

• receive a first set of audio data channels (ADCs), wherein the first set of ADCs jointly capture a speech produced by one or more speakers;
• obtain, using the first set of ADCs, a second set of one or more ADCs, wherein individual ADCs of the second set of ADCs represent one or more channels of the first set of ADCs, and wherein at least one channel of the second set of ADCs represents a cluster of two or more ADCs of the first set of ADCs, the two of more ADCs being selected based on similarity of audio data of the two or more ADCs;
• and
• process, using an audio processing neural network (NN) model, the second set of ADCs to obtain an association of the speech to the one or more speakers.