Audio dataset generation to specific audio domain using text-conditional generative models
AssigneeNEC Laboratories America, Inc.
InventorsWataru KOHNO, Jian FANG, Shaobo HAN, Ting WANG, Jungchen SUN
Life of this patent
Estimating the term…
Loading patent…
AssigneeNEC Laboratories America, Inc.
InventorsWataru KOHNO, Jian FANG, Shaobo HAN, Ting WANG, Jungchen SUN
Estimating the term…
Two-stage domain-specific signal generation schemes using a text-conditional a generative audio model. The first stage includes an Event-classification simulator with language-audio models (e.g., CLAP models), which advantageously prevents the text-conditional generative model from generating incorrect data. The second stage incorporates a Domain shifter, which performs impulse-response convolution and background noise in addition to synthesized data, emulating unique sensing signals fiber optic sensing deployments, such as those from DAS. Advantageously, our inventive schemes can generate various synthesized data belonging to unique domains and store them as a special dataset. In terms of physical effort, our techniques only need record one impulse response and one background noise, significantly reducing data collection burden and costs typically associated with fine-tuning models. Of further advantage, our inventive schemes can be applied to other unique audio devices (e.g., laser microphones) or unique environments (e.g., underwater).
A system providing domain-specific signal generation using a text-conditional generative audio model, the system comprising:
Dependencies are inferred from the claim text.