Method, apparatus and computer program for processing multi-channel signals
AssigneeNokia Technologies Oy
InventorJuha Ojanperä
Life of this patent
Estimating the term…
Abstract
The invention relates to a method and an apparatus in which samples of at least a part of an audio signal of a first channel and a part of an audio signal of a second channel are used to produce a sparse representation of the audio signals to increase the encoding efficiency. In an example embodiment one or more audio signals are input and relevant auditory cues are determined in a time-frequency plane. The relevant auditory cues are combined to form an auditory neurons map. Said one or more audio signals are transformed into a transform domain and the auditory neurons map is used to form a sparse representation of said one or more audio signal.
Claims20
A method comprising:
- inputting one or more audio signals for an audio scene;
- determining relevant auditory cues that preserve detailed information about sound features over time, said determining comprising:
- windowing said one or more audio signals, wherein said windowing comprises first and second windowings of different bandwidths to produce a first windowed audio signal and a second windowed audio signal respectively;
- transforming the first and second windowed audio signals into a transform domain;
- and
- calculating said auditory cues based on said first and second windowed audio signals;
- forming an auditory neurons map comprising paths in the transform domain of the relevant auditory cues;
- transforming said one or more audio signals into a transform domain;
- using the auditory neurons map to form a sparse representation of said one or more transformed audio signals;
- and
- outputting said sparse representation of said one or more transformed audio signals for at least one of encoding by an encoder and storing in a storage device.
An apparatus comprising
- at least one processor;
- and
- at least one non-transitory memory comprising computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:
- input one or more audio signals for an audio scene;
- determine relevant auditory cues that preserve detailed information about sound features over time, said determining comprising:
- windowing said one or more audio signals, wherein said windowing comprises first and second windowings of different bandwidths to produce a first windowed audio signal and a second windowed audio signal respectively;
- transforming the first and second windowed audio signals into a transform domain;
- and
- calculating said auditory cues based on said first and second windowed audio signals;
- form an auditory neurons map comprising paths in the transform domain of the relevant auditory cues;
- transform said one or more audio signals into a transform domain;
- use the auditory neurons map to form a sparse representation of said one or more audio signals;
- and
- output said sparse representation of said one or more transformed audio signals for at least one of encoding by an encoder and storing in a storage device.
A non-transitory computer program product comprising a computer program code configured to, with at least one processor, cause an apparatus to:
- input one or more audio signals for an audio scene;
- determine relevant auditory cues that preserve detailed information about sound features over time, said determining comprising:
- windowing said one or more audio signals, wherein said windowing comprises first and second windowings of different bandwidths to produce a first windowed audio signal and a second windowed audio signal respectively;
- transforming the first and second windowed audio signals into a transform domain;
- and
- calculating said auditory cues based on said first and second windowed audio signals;
- form an auditory neurons map comprising paths in the transform domain of the relevant auditory cues;
- transform said one or more audio signals into a transform domain;
- and
- use the auditory neurons map to form a sparse representation of said one or more transformed audio signals;
- and
- output said sparse representation of said one or more transformed audio signals for at least one of encoding by an encoder and storing in a storage device.
Dependencies are inferred from the claim text.