Audio generation methods and system
AssigneeSony Interactive Entertainment Europe Limited
InventorAdrian Barahona Rios
Life of this patent
Estimating the term…
Abstract
A method of generating audio assets, comprising the steps of: receiving an input multi-layered audio asset comprising a plurality of audio layers, generating an input multi-channel image, wherein each channel of the input multi-channel image comprises an input image representative of one of the audio layers, training a generative model on the input multi-channel image and implementing the trained generative model to generate an output multi-channel image, wherein each channel of the output multi-channel image comprises an output image representative of an output audio layer, and generating an output multi-layered audio asset based on a combination of output audio layers derived from the output images.
Claims15
A method of generating audio assets, comprising the steps of:
- receiving an input multi-layered audio asset comprising a plurality of audio layers,
- converting each audio layer into an input graphical representation,
- generating an input multi-channel image by stacking each input graphical representation in a separate channel of the multi-channel image,
- training a generative model on the input multi-channel image and implementing the trained generative model to generate an output multi-channel image, wherein each channel of the output multi-channel image comprises an output graphical representation of an output audio layer,
- separating the output graphical representations from each output multi-channel image, and
- generating an output multi-layered audio asset based on a combination of output audio layers derived from the output graphical representations.
A computer program comprising computer-implemented instructions that, when run on a computer, cause the computer to implement a method of generating audio assets, comprising the steps of:
- receiving an input multi-layered audio asset comprising a plurality of audio layers,
- converting each audio layer into an input graphical representation,
- generating an input multi-channel image by stacking each input graphical representation in a separate channel of the multi-channel image,
- training a generative model on the input multi-channel image and implementing the trained generative model to generate an output multi-channel image, wherein each channel of the output multi-channel image comprises an output graphical representation of an output audio layer,
- separating the output graphical representations from each output multi-channel image, and
- generating an output multi-layered audio asset based on a combination of output audio layers derived from the output graphical representation.
A system for generating audio assets, the system comprising:
- an asset input unit configured to receive an input multi-layered audio asset comprising a plurality of audio layers, convert each audio layer into an input graphical representation, and generate an input multi-channel image by stacking each input graphical representation in a separate channel of the multi-channel image, and
- an image generation unit configured to implement a generative model to generate one or more output multi-channel images based on the input multi-channel image, each channel of the output multi-channel image comprising an output graphical representation of an output audio layer, and
- an asset output unit configured to separate the output graphical representations from each output multi-channel image and generate an output multi-layered audio asset based on a combination of output audio layers derived from the output graphical representations.
Dependencies are inferred from the claim text.