Unsupervised singing voice conversion with pitch adversarial network
AssigneeTencent America LLC
InventorsChengzhu YU, Heng Lu, Chao Weng, Dong Yu
Life of this patent
Estimating the term…
Abstract
A method, a computer readable medium, and a computer system are provided for singing voice conversion. Data corresponding to a singing voice is received. One or more features and pitch data are extracted from the received data using one or more adversarial neural networks. One or more audio samples are generated based on the extracted pitch data and the one or more features.
Claims18
A method for singing voice conversion performed by one or more computer processors, comprising:
- receiving data corresponding to a singing voice;
- extracting one or more features from the received data;
- extracting pitch data from the received data based on a pitch regression adversarial neural network including a dropout layer, two convolutional neural networks, and a fully connected layer;
- and
- generating one or more audio samples based on the extracted pitch data and the one or more features.
2-3. (canceled)
A computer system for singing voice conversion, the computer system comprising:
- one or more computer-readable non-transitory storage media configured to store computer program code;
- and
- one or more computer processors configured to access said computer program code and operate as instructed by said computer program code, said computer program code including:
- receiving code configured to cause the one or more computer processors to receive data corresponding to a singing voice;
- first extracting code configured to cause the one or more computer processors to extract one or more features from the received data;
- second extracting code configured to cause the one or more computer processors to extract pitch data from the received data based on a pitch regression adversarial neural network including a dropout layer, two convolutional neural networks, and a fully connected layer;
- and
- generating code configured to cause the one or more computer processors to generate one or more audio samples based on the extracted pitch data and the one or more features.
12-13. (canceled)
A non-transitory computer readable medium having stored thereon a computer program for singing voice conversion, the computer program configured to cause one or more computer processors to:
- receive data corresponding to a singing voice;
- extract one or more features from the received data;
- extract pitch data from the received data based on a pitch regression adversarial neural network including a dropout layer, two convolutional neural networks, and a fully connected layer;
- and
- generate one or more audio samples based on the extracted pitch data and the one or more features.
Dependencies are inferred from the claim text.