Synthesizing personalized speech through adaptive excitation signal generation
AssigneeIncentmed IP, LLC
InventorsJohn Woodruff, James E. Kemler, Gina Vess, Sam Altonji
Life of this patent
Estimating the term…
Abstract
A speech synthesis system is described and may include at least one microphone; a speaker; a sensing system, and memory storing processor-executable instructions, which when executed by the processor, cause the processor to: detect speech-related signals emanating from the subject; generate a variable excitation signal; shape the generated variable excitation signal according to previously stored speech recordings; and cause, from the speaker and based on the shaped variable excitation signal, produced speech content that approximates the matched one or more voice characteristics in the previously stored speech recordings.
Claims21
A speech synthesis system comprising:
- at least one microphone;
- a speaker configured to be positioned within an oral cavity of a subject;
- a sensing system configured to detect speech-related signals;
- at least one processor operatively coupled to the sensing system, the speaker, and memory storing processor-executable instructions, which when executed by the processor, cause the processor to:
- detect, using the sensing system, speech-related signals emanating from the subject;
- generate, based on the detected speech-related signals emanating from the subject, a variable excitation signal, the generating comprising:
- automatically varying an excitation signal over time and predicting an upcoming trajectory of fundamental frequencies associated with the excitation signal, and
- adjusting the predicted fundamental frequencies associated with the excitation signal at predetermined time intervals to capture natural intonation patterns for the subject;
- shape the generated variable excitation signal according to previously stored speech recordings, the shaping comprising comparing the generated variable excitation signal to match one or more voice characteristics in the previously stored speech recordings;
- and
- cause, from the speaker and based on the shaped variable excitation signal, produced speech content that approximates the matched one or more voice characteristics in the previously stored speech recordings.
A computer-implemented method for generating a personalized excitation signal for a subject, the method comprising:
- detecting acoustic signals from an oral cavity of the subject;
- processing the detected signals through at least one artificial intelligence algorithm trained on banked speech corresponding to the subject;
- predicting upcoming excitation signals based on the processed signals, the predicting comprising processing the signals in temporal segments and determining excitation signal parameters for subsequent temporal segments;
- generating, based on the predicting, new excitation signals acoustically shaped according to one or more characteristics in the banked speech corresponding to the subject;
- and
- causing production of speech according to the new excitation signals, wherein the produced speech substantially matches patterns and intonation in the banked speech.
A computer-implemented method for generating speech from brain signals of a subject, the method comprising:
- detecting, based on a brain-computer interface coupled to the subject, neural signals associated with intended speech from the subject;
- decoding intended speech content from the detected neural signals;
- predicting, based on the decoded intended speech content, an excitation signal for use in producing speech corresponding to the intended speech content;
- generating, based on the predicted excitation signal, a variable excitation signal that automatically changes over time to match intonation patterns associated with the intended speech content;
- and
- causing, based on the variable excitation signal, intelligible speech output corresponding to the intended speech content, wherein the intelligible speech output comprises the intended speech acoustically shaped according to one or more voice characteristics in banked speech audio recordings of the subject.
Dependencies are inferred from the claim text.