Sound signal synthesis method, generative model training method, sound signal synthesis system, and recording medium
AssigneeYamaha Corporation
InventorsJordi BONADA, Merlijn BLAAUW, Ryunosuke DAIDO
Life of this patent
Estimating the term…
Abstract
A computer-implemented sound signal synthesis method includes: generating, based on first control data representative of a plurality of conditions of a sound signal to be generated, (i) first data representative of a sound source spectrum of the sound signal, and (ii) second data representative of a spectral envelope of the sound signal; and synthesizing the sound signal based on the sound source spectrum indicated by the first data and the spectral envelope indicated by the second data.
Claims17
A computer-implemented sound signal synthesis method comprising:
- generating, based on first control data representative of a plurality of conditions of a sound signal to be generated, (i) first data representative of a sound source spectrum of the sound signal, and (ii) second data representative of a spectral envelope of the sound signal;
- and
- synthesizing the sound signal based on the sound source spectrum indicated by the first data and the spectral envelope indicated by the second data.
A computer-implemented generative model training method comprising:
- obtaining, from a waveform spectrum of a reference signal, a spectral envelope representative of an envelope of the waveform spectrum;
- obtaining a sound source spectrum by applying whitening to the waveform spectrum, using the spectral envelope;
- and
- training a generative model that includes at least one neural network,
- wherein the generative model is trained to generate, based on first control data representative of a plurality of conditions of the reference signal, first data representative of the sound source spectrum and second data representative of the spectral envelope.
A sound signal synthesis system comprising:
- at least one processor communicatively connected to a memory and configured to execute a program to:
- generate, based on first control data representative of a plurality of conditions of a sound signal to be generated, (i) first data representative of a sound source spectrum of the sound signal, and (ii) second data representative of a spectral envelope of the sound signal;
- and
- synthesize the sound signal based on the sound source spectrum indicated by the first data and the spectral envelope indicated by the second data.
A non-transitory recording medium for storing a program implemented by a computer to execute a method comprising:
- generating, based on first control data representative of a plurality of conditions of a sound signal to be generated, (i) first data representative of a sound source spectrum of the sound signal, and (ii) second data representative of a spectral envelope of the sound signal;
- and
- synthesizing the sound signal based on the sound source spectrum indicated by the first data and the spectral envelope indicated by the second data.
Dependencies are inferred from the claim text.