Back to results
US 12,119,012 B2Granted
Method and apparatus for voice recognition in mixed audio based on pitch features using network models, and storage medium
AssigneeBeijing Xiaomi Pinecone Electronics Co., Ltd.
InventorsNa Xu, Yongtao Jia, Linzhang Wang
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to a method and an apparatus for audio processing and a storage medium. The method includes: obtaining an audio mixing feature of a target object, in which the audio mixing feature at least includes: a voiceprint feature and a pitch feature of the target object; and determining a target audio matching with the target object in the mixed audio according to the audio mixing feature.
Claims9
A method for voice recognition in a mixed audio, comprising:
- obtaining an audio signal of a target object;
- extracting a voiceprint feature of the target object according to a short-time Fourier transform amplitude spectrum of the audio signal;
- inputting the voiceprint feature into a predetermined pitch extraction network model to obtain a pitch feature, wherein the pitch feature refers to a lowest audio frequency that the target object can speak;
- determining an audio mixing feature of the target object at least comprising the voiceprint feature and the pitch feature, wherein the audio mixing feature is used as a separation parameter in a voice separation process;
- obtaining each audio feature of the mixed audio on each audio frame;
- inputting each audio feature on each audio frame and the audio mixing feature into each sub-module of a separation network model to obtain an output result of each sub-module;
- and
- obtaining a target audio matching with the target object in the mixed audio according to an overall output result of connecting the output results of all the sub-modules in series;
- wherein the method further comprises:
- obtaining the mixed audio during a voice call, wherein the mixed audio comprises the target audio and noises, and outputting an enhanced target audio by performing noise reduction and amplification on the target audio after the voice separation process.
7 more elements
An apparatus for voice recognition in a mixed audio, comprising:
- one or more processors;
- a memory storing instructions executable by the one or more processors;
- wherein the one or more processors are configured to:
- obtain an audio signal of a target object;
- extract a voiceprint feature of the target object according to a short-time Fourier transform amplitude spectrum of the audio signal;
- input the voiceprint feature into a predetermined pitch extraction network model to obtain a pitch feature, wherein the pitch feature refers to a lowest audio frequency that the target object can speak;
- determine an audio mixing feature of the target object at least comprising the voiceprint feature and the pitch feature, wherein the audio mixing feature is used as a separation parameter in a voice separation process;
- obtain each audio feature of the mixed audio on each audio frame;
- input each audio feature on each audio frame and the audio mixing feature into each sub-module of a separation network model to obtain an output result of each sub-module;
- and
- obtain a target audio matching with the target object in the mixed audio according to an overall output result of connecting the output results of all the sub-modules in series;
- wherein the one or more processors are configured to:
- obtain the mixed audio during a voice call, wherein the mixed audio comprises the target audio and noises, and
- output an enhanced target audio by performing noise reduction and amplification on the target audio after the voice separation process.
11 more elements
A non-transitory computer-readable storage medium having computer-executable instructions stored thereon, wherein when the computer-executable instructions are executed by a processor, the processor is caused to implement a method for voice recognition in a mixed audio, and the method comprises:
- obtaining an audio signal of a target object;
- extracting a voiceprint feature of the target object according to a short-time Fourier transform amplitude spectrum of the audio signal;
- inputting the voiceprint feature into a predetermined pitch extraction network model to obtain a pitch feature, wherein the pitch feature refers to a lowest audio frequency that the target object can speak;
- determining an audio mixing feature of the target object at least comprising the voiceprint feature and the pitch feature, wherein the audio mixing feature is used as a separation parameter in a voice separation process;
- obtaining each audio feature of the mixed audio on each audio frame;
- inputting each audio feature on each audio frame and the audio mixing feature into each sub-module of a separation network model to obtain an output result of each sub-module;
- and
- obtaining a target audio matching with the target object in the mixed audio according to an overall output result of connecting the output results of all the sub-modules in series;
- wherein the method further comprises:
- obtaining the mixed audio during a voice call wherein the mixed audio comprises the target audio and noises, and outputting an enhanced target audio by performing noise reduction and amplification on the target audio after the voice separation process.
7 more elements
Dependencies are inferred from the claim text.