Audio data processing method for wake-up speech detection, apparatus, and storage medium

An audio data processing apparatus, comprising:

• at least one memory storing computer program instructions;
• and at least one processor coupled to the at least one memory and configured to executing the computer program instructions and perform:
• obtaining multi-path audio data in an environmental space;
• obtaining a speech data set based on the multi-path audio data;
• separately generating, in a plurality of enhancement directions, a plurality of pieces of enhanced speech information corresponding to the speech data set;
• matching, by using a first wake-up detection model, a speech hidden feature in each piece of enhanced speech information with a target matching word to obtain a degree of matching with the target matching word, and determining an enhancement direction corresponding to target enhanced speech information having a highest degree of matching with the target matching word among the plurality of pieces of enhancement speech information as a target audio direction;
• obtaining, by using a second wake-up detection model, a speech spectrum feature in the target enhanced speech information in the target audio direction;
• and
• determining a probability of existence of the target matching word in the target audio direction for controlling a terminal, comprising:
• concatenating the speech hidden feature and the speech spectrum feature of the target enhanced speech information in the target audio direction, to obtain a concatenated vector feature;
• and
• determining, by using the second wake-up detection model, a degree of matching between the concatenated vector feature and a target wake-up feature, to generate the probability of existence of the target matching word.

A non-transitory electronic-readable storage medium storing computer program instructions executable by at least one processor to perform:

• obtaining multi-path audio data in an environmental space;
• obtaining a speech data set based on the multi-path audio data;
• separately generating, in a plurality of enhancement directions, a plurality of pieces of enhanced speech information corresponding to the speech data set;
• matching, by using a first wake-up detection model, a speech hidden feature in each piece of enhanced speech information with a target matching word to obtain a degree of matching with the target matching word, and determining an enhancement direction corresponding to target enhanced speech information having a highest degree of matching with the target matching word among the plurality of pieces of enhancement speech information as a target audio direction;
• obtaining, by using a second wake-up detection model, a speech spectrum feature in the target enhanced speech information in the target audio direction;
• and
• determining a probability of existence of the target matching word in the target audio direction for controlling a terminal, comprising:
• concatenating the speech hidden feature and the speech spectrum feature of the target enhanced speech information in the target audio direction, to obtain a concatenated vector feature;
• and
• determining, by using the second wake-up detection model, a degree of matching between the concatenated vector feature and a target wake-up feature, to generate the probability of existence of the target matching word.