Sequence models for audio scene recognition

A computer program product for audio scene classification, the computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method comprising:

• generating intermediate audio features from an input acoustic sequence;
• and
• classifying, using a nearest neighbor search, segments of the input acoustic sequence based on the intermediate audio features to generate a final intermediate feature as a classification for the input acoustic sequence, each of the segments corresponding to a respective different one of different acoustic windows;
• wherein said generating step comprises:
• learning the intermediate audio features from Multi-Frequency Cepstral Component (MFCC) features extracted from the input acoustic sequence;
• dividing the same scene into the different acoustic windows having varying ones of the MFCC features;
• and
• feeding the MFCC features of each of the different acoustic windows into respective LSTM units such that a hidden state of each of the respective LSTM units is passed through an attention layer to identify feature correlations between hidden states at different time steps corresponding to different ones of the different acoustic windows.

A computer processing system for audio scene classification, comprising:

• a memory device for storing program code;
• and
• a hardware processor, operatively coupled to the memory device, for running the program code to
• generate intermediate audio features from an input acoustic sequence;
• and
• classify, using a nearest neighbor search, segments of the input acoustic sequence based on the intermediate audio features to generate a final intermediate feature as a classification for the input acoustic sequence, each of the segments corresponding to a respective different one of different acoustic windows;
• wherein the hardware processor runs the program code to generate the intermediate audio features to
• learn the intermediate audio features from Multi-Frequency Cepstral Component (MFCC) features extracted from the input acoustic sequence;
• divide the same scene into the different acoustic windows having varying ones of the MFCC features;
• and
• feed the MFCC features of each of the different acoustic windows into respective LSTM units such that a hidden state of each of the respective LSTM units is passed through an attention layer to identify feature correlations between hidden states at different time steps corresponding to different ones of the different acoustic windows.