Back to results
US 2024/0185831 A1Published application
Generating a synthetic voice using neural networks
AssigneeMeca Holdings IP LLC
InventorClaude Polonov
Life of this patent
Estimating the term…
Abstract
A method of generating a synthetic voice by capturing audio data, cutting it into discrete phoneme and pitch segments, forming superior phoneme and pitch segments by averaging segments having similar phoneme, pitch, and other sound qualities, and training neural networks to correctly concatenate the segments.
Claims14
A method of generating a synthetic voice, comprising the steps of:
- a. identifying phonemes within each speech segment within a set of speech segments derived from a common speaker using a phoneme processor;
- b. clipping each speech segment to isolate the separate phonemes within each speech segment, thereby forming phoneme segments;
- c. grouping the phoneme segments such that each group of phoneme segments have a common phoneme type;
- d. converting the phoneme segments into spectral Mel-Scale data segments using a Mel-Spectrogram to form a first set of spectral segments;
- e. performing SPL analysis on each spectral segment in the first set of spectral segments to generate a first set of SPL tracks, with each SPL track of the first set of SPL tracks corresponding to a given spectral segment and identifying sound pressure, tone, and pause attributes of the given spectral segment;
- f. grouping the first set of spectral segments such that every spectral segment within a group of spectral segments has common sound pressure, tone, and pause attributes;
- g. inputting the first set of spectral segments and the first set of SPL tracks into a first neural vocoder;
- h. comparing sound pressure, tone, pause, and phoneme attributes of the first set of spectral segments to standard sound pressure, tone, pause, and phoneme attribute ranges, with the standard attribute ranges selected for comparison determined by the phoneme group and the SPL tracks;
- i. culling spectral segments with attributes that fall outside standard attribute ranges from the first set of spectral segments;
- j. providing a second neural vocoder configured to predict subsequent phonemes, with the second neural vocoder comprising a plurality of layers including a first phoneme layer, a second phoneme layer, a phoneme weight layer;
- i. with the phoneme weight layer comprising a first set of weight nodes, with each weight node of the first set of weight nodes associated with a likelihood that a node from the first phoneme layer will be succeeded by a node from the second phoneme layer.
8 more elements
A method of generating a synthetic voice, comprising the steps of:
- a. converting phoneme segments having a common phoneme type into a first set of spectral segments;
- b. performing sound analysis on each spectral segment in the first set of spectral segments to generate a first set of analysis tracks, with each analysis track of the first set of analysis tracks corresponding to a given spectral segment and identifying sound attributes of the given spectral segment;
- c. grouping the first set of spectral segments such that every spectral segment within a group of spectral segments has common sound attributes;
- d. inputting the first set of spectral segments and the first set of analysis tracks into a first neural vocoder;
- e. comparing sound attributes of the first set of spectral segments to standard sound attribute ranges, with the standard sound attribute ranges selected for comparison determined by the phoneme group and the analysis tracks;
- f. culling spectral segments with attributes that fall outside standard attribute ranges from the first set of spectral segments.
3 more elements
A method of generating a synthetic voice, comprising the steps of:
- a. converting phoneme segments into spectral data segments to form a first set of spectral segments;
- b. performing sound analysis on each spectral segment in the first set of spectral segments to generate a first set of sound analysis tracks, with each sound analysis track of the first set of sound analysis tracks corresponding to a given spectral segment and identifying sound attributes of the given spectral segment;
- c. grouping the first set of spectral segments such that every spectral segment within a group of spectral segments has common sound attributes;
- d. providing a first neural vocoder configured to predict subsequent phonemes.
1 more element
Dependencies are inferred from the claim text.