Audio recognition method and system and machine device
AssigneeTencent Technology (Shenzhen) Company Limited
InventorsDan Su, Jun Wang, Jie Chen, Dong Yu
Life of this patent
Estimating the term…
Abstract
A neural network training method is provided. The method includes obtaining an audio data stream, performing, for different audio data of each time frame in the audio data stream, feature extraction in each layer of a neural network, to obtain a depth feature outputted by a corresponding time frame, fusing, for a given label in labeling data, an inter-class confusion measurement index and an intra-class distance penalty value relative to the given label in a set loss function for the audio data stream through the depth feature, and updating a parameter in the neural network by using a loss function value obtained through fusion.
Claims20
A neural network training method for implementing audio recognition, applicable to an audio recognition terminal, the method comprising:
- obtaining an audio data stream for neural network training of audio recognition, the audio data stream including audio data respectively corresponding to a plurality of time frames;
- performing, for different audio data of each time frame in the audio data stream, feature extraction in each layer of a trained neural network, to obtain a depth feature outputted by a corresponding time frame;
- fusing, for a given label in labeling data, an inter-class confusion measurement index and an intra-class distance penalty value relative to the given label in a set loss function for the audio data stream through the depth feature;
- and
- obtaining, through fusion, a loss function value relative to a series of given labels in the labeling data, to update a parameter in the neural network.
A neural network training system for implementing audio recognition, the audio recognition system comprising:
- a memory storing computer program instructions;
- and a processor coupled to the memory and configured to execute the computer program instructions to perform:
- obtaining an audio data stream for neural network training of audio recognition, the audio data stream including audio data respectively corresponding to a plurality of time frames;
- performing, for different audio data of each time frame in the audio data stream, feature extraction in each layer of a trained neural network, to obtain a depth feature outputted by a corresponding time frame;
- fusing, for a given label in labeling data, an inter-class confusion measurement index and an intra-class distance penalty value relative to the given label in a set loss function for the audio data stream through the depth feature;
- and
- obtaining, through fusion, a loss function value relative to a series of given labels in the labeling data, to update a parameter in the neural network.
A non-transitory computer-readable storage medium storing computer program instructions executable by at least one processor to perform:
- obtaining an audio data stream for neural network training of audio recognition, the audio data stream including audio data respectively corresponding to a plurality of time frames;
- performing, for different audio data of each time frame in the audio data stream, feature extraction in each layer of a trained neural network, to obtain a depth feature outputted by a corresponding time frame;
- fusing, for a given label in labeling data, an inter-class confusion measurement index and an intra-class distance penalty value relative to the given label in a set loss function for the audio data stream through the depth feature;
- and
- obtaining, through fusion, a loss function value relative to a series of given labels in the labeling data, to update a parameter in the neural network.
Dependencies are inferred from the claim text.