Back to results
US 11,606,661 B2Granted
Recording and rendering spatial audio signals
AssigneeNokia Technologies Oy
InventorsJuha Vilkamo, Mikko-Ville Laitinen
Life of this patent
Estimating the term…
Abstract
Examples of the disclosure relate to a method, apparatus and computer program, the method including: obtaining audio signals wherein the audio signals represent spatial sound and can be used to render spatial audio using linear methods; obtaining spatial metadata corresponding to the spatial sound represented by the audio signals; and associating the spatial metadata with the obtained audio signals so that in a first rendering context the obtained audio signals can be rendered without using the spatial metadata and in a second rendering context the obtained audio signals can be rendered with using the spatial metadata.
Claims19
A method comprising:
- obtaining audio signals wherein the audio signals represent spatial sound of a sound space and are configured to be used to render spatial audio using linear methods;
- obtaining spatial metadata corresponding to the sound space represented with the audio signals, wherein the spatial metadata comprises metadata associated with respective frequency bands of the audio signals;
- and
- associating the spatial metadata with the obtained audio signals so that in a first rendering context the obtained audio signals are used to render spatial audio that is determined using at least one of the linear methods and without using the spatial metadata, and in a second rendering context the obtained audio signals are used to render spatial audio using the spatial metadata, wherein using the spatial metadata to process the obtained audio signals comprises, at least:
- using the spatial metadata in response to a movement of a listener to process audio signals that are determined using one or more of the linear methods, and
- determining at least one direct part of the obtained audio signals and at least one ambient part of the obtained audio signals based, at least partially, on the spatial metadata,
- wherein associating the spatial metadata with the obtained audio signals comprises at least one of:
- transmitting the spatial metadata and the obtained audio signals to a rendering device;
- or
- storing the spatial metadata with the obtained audio signals.
7 more elements
A method comprising:
- obtaining audio signals wherein the audio signals represent spatial sound of a sound space and are configured to be used to render spatial audio using linear methods;
- obtaining spatial metadata corresponding to the sound space represented with the audio signals, wherein the spatial metadata comprises metadata associated with respective frequency bands of the audio signals, wherein the spatial metadata comprises at least one of:
- distance parameters, direction parameters, or energy ratio parameters;
- and
- associating the spatial metadata with the obtained audio signals so that in a first rendering context the obtained audio signals are used to render spatial audio that is determined using at least one of the linear methods and without using the spatial metadata, and in a second rendering context the obtained audio signals are used to render spatial audio using the spatial metadata, wherein using the spatial metadata to process the obtained audio signals comprises using the spatial metadata in response to a movement of a listener to process audio signals that are determined using one or more of the linear methods, wherein associating the spatial metadata with the obtained audio signals comprises at least one of:
- transmitting the spatial metadata and the obtained audio signals to a rendering device;
- or
- storing the spatial metadata with the obtained audio signals.
5 more elements
A method comprising:
- obtaining audio signals wherein the audio signals represent a sound scene and are configured to be used to render spatial audio using linear methods;
- obtaining spatial metadata corresponding to the sound scene represented with the audio signals;
- and
- associating the spatial metadata with the obtained audio signals so that in a first rendering context the obtained audio signals are used to render spatial audio without using the spatial metadata, and in a second rendering context the obtained audio signals are used to render spatial audio using the spatial metadata, wherein using the spatial metadata to process the obtained audio signals increases the spatial accuracy of the rendered audio signals, wherein associating the spatial metadata with the obtained audio signals comprises at least one of:
- transmitting the spatial metadata and the obtained audio signals to a rendering device;
- or
- storing the spatial metadata with the obtained audio signals,
- wherein the spatial metadata comprises information indicating how energy levels in one or more frequency sub-bands of the obtained audio signals have been modified.
5 more elements
An apparatus comprising:
- processing circuitry;
- and
- memory circuitry including computer program code, the memory circuitry and the computer program code configured to, with the processing circuitry, enable the apparatus to:
- obtain audio signals wherein the audio signals represent spatial sound of a sound space and are configured to be used to render spatial audio using linear methods;
- obtain spatial metadata corresponding to the sound space represented with the audio signals, wherein the spatial metadata comprises metadata associated with respective frequency bands of the audio signals;
- and
- associate the spatial metadata with the obtained audio signals so that in a first rendering context the obtained audio signals are used to render spatial audio that is determined using at least one of the linear methods and without using the spatial metadata, and in a second rendering context the obtained audio signals are used to render spatial audio using the spatial metadata, wherein using the spatial metadata to process the obtained audio signals comprises enabling the apparatus to, at least:
- use the spatial metadata in response to a movement of a listener to process audio signals that are determined using one or more of the linear methods, and
- determine at least one direct part of the obtained audio signals and at least one ambient part of the obtained audio signals based, at least partially, on the spatial metadata,
- wherein associating the spatial metadata with the obtained audio signals comprises enabling the apparatus to at least one of:
- transmit the spatial metadata and the obtained audio signals to a rendering device;
- or
- store the spatial metadata with the obtained audio signals.
10 more elements
An apparatus comprising:
- processing circuitry;
- and
- memory circuitry including computer program code, the memory circuitry and the computer program code configured to, with the processing circuitry, enable the apparatus to:
- obtain audio signals wherein the audio signals represent spatial sound of a sound space and are configured to be used to render spatial audio using linear methods;
- obtain spatial metadata corresponding to the sound space represented with the audio signals, wherein the spatial metadata comprises metadata associated with respective frequency bands of the audio signals, wherein the spatial metadata comprises at least one of:
- distance parameters, direction parameters, or energy ratio parameters;
- and
- associate the spatial metadata with the obtained audio signals so that in a first rendering context the obtained audio signals are used to render spatial audio that is determined using at least one of the linear methods and without using the spatial metadata, and in a second rendering context the obtained audio signals are used to render spatial audio using the spatial metadata, wherein using the spatial metadata to process the obtained audio signals comprises using the spatial metadata in response to a movement of a listener to process audio signals that are determined using one or more of the linear methods, wherein associating the spatial metadata with the obtained audio signals comprises enabling the apparatus to at least one of:
- transmit the spatial metadata and the obtained audio signals to a rendering device;
- or
- store the spatial metadata with the obtained audio signals.
8 more elements
An apparatus comprising:
- processing circuitry;
- and
- memory circuitry including computer program code, the memory circuitry and the computer program code configured to, with the processing circuitry, enable the apparatus to:
- obtain audio signals wherein the audio signals represent a sound scene and are configured to be used to render spatial audio using linear methods;
- obtain spatial metadata corresponding to the sound scene represented with the audio signals;
- and
- associate the spatial metadata with the obtained audio signals so that in a first rendering context the obtained audio signals are used to render spatial audio without using the spatial metadata, and in a second rendering context the obtained audio signals are used to render spatial audio using the spatial metadata, wherein using the spatial metadata to process the obtained audio signals increases the spatial accuracy of the rendered audio signals, wherein associating the spatial metadata with the obtained audio signals comprises enabling the apparatus to at least one of:
- transmit the spatial metadata and the obtained audio signals to a rendering device;
- or
- store the spatial metadata with the obtained audio signals,
- wherein the spatial metadata comprises information indicating how energy levels in one or more frequency sub-bands of the obtained audio signals have been modified.
8 more elements
Dependencies are inferred from the claim text.