Text time annotation method and apparatus, electronic device, and readable storage medium

An electronic device comprising:

• a memory;
• at least one processor;
• and
• a transceiver,
• wherein the at least one processor is coupled to the memory and the transceiver and configured for:
• receiving an annotation request, wherein the annotation request is used to request to annotate a playing start-end time period of each text unit in a text corresponding to target audio, wherein each text unit is at least a character, a word or an expression;
• obtaining a playing start-end time period of each text unit in the text corresponding to the target audio based on a fundamental frequency of the target audio;
• obtaining an annotation file based on annotating the playing start-end time period of each text unit in the text based on the playing start-end time period of each text unit in the text corresponding to the target audio;
• outputting the annotation file;
• and
• controlling the transceiver to perform message receiving and message sending,
• wherein obtaining the playing start-end time period of each text unit in the text corresponding to the target audio based on the fundamental frequency of the target audio comprises obtaining a first moment at which a change rate of the fundamental frequency is greater than a change rate threshold, the first moment indicating an interval moment between two adjacent text units in the text corresponding to the target audio,
• wherein obtaining the playing start-end time period of each text unit in the text corresponding to the target audio based on the fundamental frequency of the target audio further comprises obtaining the playing start-end time period of each text unit in the text corresponding to the target audio based on the fundamental frequency of the target audio and short-time energy of the target audio,
• wherein the target audio comprises at least one sub-audio segment,
• wherein obtaining the first moment at which the change rate of the fundamental frequency is greater than a change rate threshold comprises obtaining, based on a fundamental frequency of the sub-audio segment, a moment at which the change rate of the fundamental frequency is greater than a change rate threshold in the sub-audio segment, and
• wherein obtaining the playing start-end time period of each text unit in the text corresponding to the target audio based on the fundamental frequency of the target audio and short-time energy of the target audio further comprises:
• when a quantity of first moments is greater than or equal to a quantity of text units in a text corresponding to the sub-audio segment, obtaining a second moment from the first moment based on short-time energy of the sub-audio segment, wherein an average value of the short-time energy between two adjacent second moments is less than a first short-time energy threshold, and
• obtaining the playing start-end time period of each of the text unit in the text corresponding to the target audio based on obtaining a playing start-end time period of each text unit in the text corresponding to the sub-audio segment based on the first moment and the second moment.

A non-transitory computer-readable storage medium, wherein the storage medium stores programming to be executed by a computer, and wherein the programming comprises instructions for

• receiving an annotation request, wherein the annotation request is used to request to annotate a playing start-end time period of each text unit in a text corresponding to target audio, and wherein each text unit is at least a character, a word or an expression;
• obtaining a playing start-end time period of each text unit in the text corresponding to the target audio based on a fundamental frequency of the target audio;
• obtaining an annotation file based on annotating the playing start-end time period of each text unit in the text based on the playing start-end time period of each text unit in the text corresponding to the target audio;
• and
• outputting the annotation file,
• wherein obtaining the playing start-end time period of each text unit in the text corresponding to the target audio based on the fundamental frequency of the target audio comprises obtaining a first moment at which a change rate of the fundamental frequency is greater than a change rate threshold, the first moment indicating an interval moment between two adjacent text units in the text corresponding to the target audio,
• wherein obtaining the playing start-end time period of each text unit in the text corresponding to the target audio based on the fundamental frequency of the target audio further comprises obtaining the playing start-end time period of each text unit in the text corresponding to the target audio based on the fundamental frequency of the target audio and short-time energy of the target audio,
• wherein the target audio comprises at least one sub-audio segment,
• wherein obtaining the first moment at which the change rate of the fundamental frequency is greater than a change rate threshold comprises obtaining, based on a fundamental frequency of the sub-audio segment, a moment at which the change rate of the fundamental frequency is greater than a change rate threshold in the sub-audio segment, and
• wherein obtaining the playing start-end time period of each text unit in the text corresponding to the target audio based on the fundamental frequency of the target audio and short-time energy of the target audio further comprises:
• when a quantity of first moments is greater than or equal to a quantity of text units in a text corresponding to the sub-audio segment, obtaining a second moment from the first moment based on short-time energy of the sub-audio segment, wherein an average value of the short-time energy between two adjacent second moments is less than a first short-time energy threshold, and
• obtaining the playing start-end time period of each of the text unit in the text corresponding to the target audio based on obtaining a playing start-end time period of each text unit in the text corresponding to the sub-audio segment based on the first moment and the second moment.