Inter-channel feature extraction method, audio separation method and apparatus, and computing device

A computing device, comprising a processor and a memory, the memory storing instructions, the instructions, when executed on the processor, causing the processor to perform a plurality of operations including:

• transforming one of a plurality of channel components of the multi-channel multi-sound source mixed audio signal into a single-channel multi-sound source mixed audio representation in a feature space;
• performing a two-dimensional dilated convolution on the multi-channel multi-sound source mixed audio signal to extract a plurality of inter-channel features based on a plurality of different values of an inter-channel dilation coefficient z and/or a plurality of different values of an inter-channel stride p and at least one parallel two-dimensional convolutional layer;
• performing a feature fusion on the single-channel multi-sound source mixed audio representation and the plurality of inter-channel features to obtain a fused multi-channel multi-sound source mixed audio feature;
• estimating respective weights of a plurality of sound sources in the single-channel multi-sound source mixed audio representation based on the fused multi-channel multi-sound source mixed audio feature;
• obtaining respective representations of the plurality of sound sources according to the single-channel multi-sound source mixed audio representation and the respective weights;
• and
• transforming the respective representations of the plurality of sound sources into respective audio signals of the plurality of sound sources.

A non-transitory computer-readable storage medium, storing instructions, the instructions, when executed on a processor, causing the processor to perform a plurality of operations including:

• transforming one of a plurality of channel components of the multi-channel multi-sound source mixed audio signal into a single-channel multi-sound source mixed audio representation in a feature space;
• performing a two-dimensional dilated convolution on the multi-channel multi-sound source mixed audio signal to extract a plurality of inter-channel features based on a plurality of different values of an inter-channel dilation coefficient z and/or a plurality of different values of an inter-channel stride p and at least one parallel two-dimensional convolutional layer;
• performing a feature fusion on the single-channel multi-sound source mixed audio representation and the plurality of inter-channel features to obtain a fused multi-channel multi-sound source mixed audio feature;
• estimating respective weights of a plurality of sound sources in the single-channel multi-sound source mixed audio representation based on the fused multi-channel multi-sound source mixed audio feature;
• obtaining respective representations of the plurality of sound sources according to the single-channel multi-sound source mixed audio representation and the respective weights;
• and
• transforming the respective representations of the plurality of sound sources into respective audio signals of the plurality of sound sources.