Global frequency-warping transformation estimation for voice timbre approximation

A system for converting a source voice to a target voice, the system comprises:

• a first microphone for recording source voice data, wherein the source voice data comprises a first plurality of frames;
• a second microphone for recording target voice data, wherein the target voice data comprises a second plurality of frames;
• a feature extractor for extracting spectral envelope features from the first plurality of frames and second plurality of frames;
• a first processor for:
• a) time-aligning pairs of frames based on the extracted spectral envelope features, each pair of frames comprising one of the first plurality of frames and one of the second plurality of frames;
• b) converting each pair of frames into a frequency domain;
• c) generating a plurality of frequency-warping factor candidates, wherein each of the plurality of frequency-warping factor candidates is associated with one of the pairs of frames;
• d) generating a single global frequency-warping factor from the plurality of frequency-warping factor candidates;
• wherein the first microphone is further configured to acquire source speech;
• a second processor is configured to:
• a) convert the source speech to target speech based on the global frequency-warping factor,
• b) generate a waveform comprising the target speech;
• and
• a speaker for playing the waveform comprising the target speech to a user;
• wherein generating a plurality of frequency-warping factor candidates comprises, for each pair of frames, identifying a frequency-warping factor candidate that minimizes a matching error between a spectrum of a source frame and a frequency-warped spectrum of a target frame;
• wherein generating a single global frequency-warping factor from the plurality of frequency-warping factor candidates comprises generating a histogram of frequency-warping factor candidates;
• wherein generating a single global frequency-warping factor from the plurality of frequency-warping factor candidates further comprises identifying three peaks including a maximal peak in the histogram of frequency-warping factor candidates;
• wherein generating a single global frequency-warping factor from the plurality of frequency-warping factor candidates further comprises:
• a) retaining frequency-warping factor candidates corresponding to the maximal peak in the histogram;
• b) removing frequency-warning factor candidates corresponding to the remaining two peaks in the histogram;
• and
• c) generating the global frequency-warping factor based on the plurality of frequency-warping factor candidates corresponding to the maximal peak in the histogram.