Method and apparatus for training and using a microphone geometry assisted encoder model to generate spatial audio signals technological field

A method comprising:

• receiving geometry data related to a plurality of microphones of an audio capturing device and audio signal data captured by the plurality of microphones;
• and
• generating a spatial audio signal based on an output of a trained microphone geometry assisted encoder model,
• wherein the trained microphone geometry assisted encoder model comprises a geometry encoder configured to encode the geometry data and a signal encoder configured to encode the audio signal data,
• wherein the geometry encoder and the signal encoder respectively comprise a plurality of layers and the trained microphone geometry assisted encoder model also comprises a plurality of connection links configured to connect respective layers of the geometry encoder and the signal encoder such that the signal encoder is configured to process both geometric data and audio signal data,
• wherein the trained microphone geometry assisted encoder model further comprises a signal decoder comprising a plurality of layers and configured to generate the output upon which the spatial audio signal is based, a plurality of connection links configured to connect respective layers of the signal encoder and the signal decoder, and a bottleneck connector between the signal encoder and the signal decoder.

A method comprising:

• providing geometry data related to a plurality of microphones of a microphone array and audio signal data to a microphone geometry assisted encoder model,
• wherein the microphone geometry assisted encoder model comprises a geometry encoder configured to encode the geometry data and a signal encoder configured to encode the audio signal data,
• wherein the geometry encoder and the signal encoder respectively comprise a plurality of layers and the microphone geometry assisted encoder model also comprises a plurality of connection links configured to connect respective layers of the geometry encoder and the signal encoder such that the signal encoder is configured to process both geometric data and audio signal data,
• wherein the microphone geometry assisted encoder model further comprises a signal decoder comprising a plurality of layers and configured to generate an output, a plurality of connection links configured to connect respective layers of the signal encoder and the signal decoder, and a bottleneck connector between the signal encoder and the signal decoder;
• and
• generating a predicted spatial audio signal based on the output of the microphone geometry assisted encoder model;
• performing a comparison of the predicted spatial audio signal with a representation of a reference audio signal;
• and
• training the microphone geometry assisted encoder model by modifying the microphone geometry assisted encoder model based upon the comparison.