Method for synthesizing an audio waveform from a text description
AssigneesDolby Laboratories Licensing Corporation, Dolby International AB
InventorsHao-Wen DONG, Xiaoyu LIU, Gautam BHATTACHARYA, Jordi PONS PUIG, Santiago PASCUAL, Joan SERRA
Life of this patent
Estimating the term…
Abstract
An aspect of the present disclosure relates to a method for synthesizing an audio waveform from a text description indicating a desired sound, the method comprising: determining a text embedding from the text description; determining an image embedding from the text embedding; synthesizing a spectrogram by inputting the image embedding to a generative model trained to synthesize a spectrogram given an input image embedding; and converting the synthesized spectrogram to the audio waveform.
Claims24
A method for synthesizing an audio waveform from a text description indicating a desired sound, the method comprising:
- determining a text embedding from the text description;
- determining an image embedding from the text embedding;
- synthesizing a spectrogram by inputting the image embedding to a generative model trained to synthesize a spectrogram given an input image embedding;
- and
- converting the synthesized spectrogram to the audio waveform.
(canceled)
(canceled)
(canceled)
(canceled)
A system for synthesizing an audio waveform from a text description, the system configured to implement the method according to any one of the preceding claims.
Dependencies are inferred from the claim text.