Audio generation methods and systems
AssigneeSony Interactive Entertainment Europe Limited
InventorAdrian Barahona Rios
Life of this patent
Estimating the term…
Abstract
Generating audio assets by receiving a plurality of input audio assets, converting each input audio asset into an input graphical representation, generating an input multi-channel image by stacking each input graphical representation in a separate channel of the image, feeding the input multi-channel image into a generative model to train the generative model and generate one or more output multi-channel images, each output multi-channel image including an output graphical representation, extracting the output graphical representations from each output multi-channel image and converting each output graphical representation into an output audio asset.
Claims14
A method of generating audio assets, comprising the steps of:
- receiving a plurality of input audio assets,
- converting each input audio asset into an input graphical representation,
- generating an input image from respective input graphical representations,
- feeding the input image into a generative model to train the generative model and generate one or more output images, each output image comprising an output graphical representation, and
- extracting the output graphical representations from each output image and converting each output graphical representation into an output audio asset,
- wherein the step of receiving a plurality of input audio assets comprises receiving, from a video game environment, video game information, and the step of generating one or more output images comprises feeding the video game information into the generative model such that the output image is influenced by the video game information.
A computer program comprising computer-implemented instructions that, when run on a computer, cause the computer to implement a method of generating audio assets comprising the steps of:
- receiving a plurality of input audio assets,
- converting each input audio asset into an input graphical representation,
- generating an input image from respective input graphical representations,
- feeding the input image into a generative model to train the generative model and generate one or more output images, each output image comprising an output graphical representation, and
- extracting the output graphical representations from each output image and converting each output graphical representation into an output audio asset,
- wherein the step of receiving a plurality of input audio assets comprises receiving, from a video game environment, video game information, and the step of generating one or more output images comprises feeding the video game information into the generative model such that the output image is influenced by the video game information.
A system for generating audio assets, the system comprising:
- an asset input unit configured to receive a plurality of input audio assets, convert each input audio asset into an input graphical representation, and generate an input image from respective input graphical representations, and
- an image generation unit configured to implement a generative model to generate one or more output images based on the input image, each output image comprising an output graphical representation, and
- an asset output unit configured to separate the output graphical representations from each output image and convert each output graphical representation into an output audio asset, and
- further comprising a video game data processing unit, configured to process video game information derived from or relating to a video game environment and feed through to one or more of the asset input unit, the image generation unit and the asset output unit, and the image generation unit is configured to implement the generative model based at least in part on the video game information.
Dependencies are inferred from the claim text.