Back to results
US 8,284,946 B2Granted
Binaural decoder to output spatial stereo sound and a decoding method thereof
AssigneeSamsung Electronics Co., Ltd.
InventorsHan-gil Moon, Sun-min Kim, In-gyu Chun
Life of this patent
Estimating the term…
Abstract
A binaural decoder for an MPEG surround stream, which decodes an MPEG surround stream into a stereo 3D signal, and a decoding method thereof. The method includes dividing a compressed audio stream and head related transfer function (HRTF) data into subbands, selecting predetermined subbands of the HRTF data divided into subbands and filtering the HRTF data to obtain the selected subbands, decoding the audio stream divided into subbands into a stream of multi-channel audio data with respect to subbands according to spatial additional information, and binaural-synthesizing the HRTF data of the selected subbands with the multi-channel audio data of corresponding subbands.
Claims33
A method of decoding a compressed audio stream into a stereo sound signal comprising:
- dividing a compressed audio stream and head related transfer function (HRTF) data into subbands;
- selecting the subbands of one or more predetermined bands of the HRTF data by filtering the HRTF data;
- decoding the divided audio stream into a stream of multi-channel audio data with respect to the subbands according to spatial parameters;
- and
- binaural-synthesizing the HRTF data of the selected subbands with the stream of multi-channel audio data of corresponding subbands.
2 more elements
A binaural decoding apparatus to binaurally decode a compressed audio stream, comprising:
- a subband analysis unit to analyze each of the compressed audio stream and head related transfer function (HRTF) data with respect to subbands;
- a subband filter unit to select one or more of the subbands of predetermined bands of the HRTF data analyzed in the subband analysis unit and to filter the HRTF data to obtain the selected subbands;
- a spatial synthesis unit to decode the audio stream analyzed in the subband analysis unit into a stream of multi-channel audio data with respect to the subbands according to spatial parameters;
- a binaural synthesis unit, by using at least one hardware processor, to binaural-synthesize the HRTF data of the selected subbands with the corresponding subbands of the stream of multi-channel audio data decoded in the spatial synthesis unit;
- and
- a subband synthesis unit to subband-synthesize audio data output with respect to the subbands from the binaural synthesis unit.
3 more elements
An MPEG surround system comprising:
- an encoder unit to generate an audio stream and channel additional information, the audio stream obtained by downmixing a plurality of channels of MPEG audio data into a predetermined number of channels;
- and
- a decoder unit, using at least one hardware processor, to analyze each of the audio stream generated in the encoder unit and preset HRTF data with respect to subbands, to select and filter the HRTF data to obtain one or more of the subbands of predetermined HRTF bands of the HRTF data analyzed with respect to the subbands, to decode the analyzed audio stream analyzed into a stream of multi-channel audio data with respect to the subbands according to spatial parameters, to binaural-synthesize the HRTF data of the obtained one or more subbands and the decoded multi-channel audio data, and to subband-synthesize a stream of audio data output with respect to the subbands.
A non-transitory, computer readable recording medium having embodied thereon a computer program to execute a method, wherein the method comprises:
- dividing a compressed audio stream and HRTF data into subbands;
- selecting the subbands of one or more predetermined HTRF bands of the HRTF data by filtering the HRTF data;
- decoding the divided audio stream into a stream of multi-channel audio data with respect to the subbands according to spatial parameters;
- and
- binaural-synthesizing the HRTF data of the selected subbands with the stream of multi-channel audio data of the corresponding subbands.
2 more elements
An MPEG surround system, comprising:
- a decoder, by using at least one hardware processor, to analyze each of a generated audio stream and preset HRTF data with respect to subbands, to select and filter the HRTF data to obtain one or more of the subbands of predetermined HRTF bands of the HRTF data analyzed with respect to the subbands, to decode the analyzed audio stream analyzed into a stream of multi-channel audio data with respect to the subbands according to spatial parameters, to binaural-synthesize the HRTF data of the obtained subbands and the decoded multi-channel audio data, and to subband-synthesize a stream of audio data output with respect to the subbands.
A mobile device having an MPEG surround system, comprising:
- a decoder comprising:
- an analysis unit to divide an audio stream and HRTF data with respect to subbands,
- a subband filter unit to filter the HRTF data to obtain one or more of the subbands of the HRTF data,
- a spatial synthesis unit to decode the divided audio stream into a stream of multi-channel audio data with respect to the subbands according to spatial parameters, and
- a binaural-synthesis unit, by using at least one hardware processor, to binaural-synthesize the HRTF data of the obtained one or more subbands with the corresponding subbands of the stream of multi-channel audio data.
2 more elements
A method of producing an MPEG surround sound in a mobile device, the method comprising:
- generating an audio stream and channel additional information, the audio stream obtained by downmixing a plurality of channels of MPEG audio data into a predetermined number of channels;
- analyzing each of the generated audio stream and preset HRTF data with respect to subbands;
- selecting and filtering the HRTF data to obtain one or more of the subbands of predetermined HRTF bands of the HRTF data analyzed with respect to the subbands;
- decoding the analyzed audio stream analyzed into a stream of multi-channel audio data with respect to the subbands according to spatial parameters;
- binaural-synthesizing the HRTF data of the obtained one or more subbands and the decoded multi-channel audio data;
- and
- subband-synthesizing a stream of audio data output with respect to the subbands.
4 more elements
A method of producing an MPEG surround sound in a mobile device, the method comprising:
- analyzing each of a generated audio stream and preset HRTF data with respect to subbands;
- selecting and filtering the HRTF data to obtain one or more of the subbands of predetermined HRTF bands of the HRTF data analyzed with respect to the subbands;
- decoding the analyzed audio stream analyzed into a stream of multi-channel audio data with respect to the subbands according to spatial parameters;
- binaural-synthesizing the HRTF data of the obtained subbands and the decoded multi-channel audio data;
- and
- subband-synthesizing a stream of audio data output with respect to the subbands.
3 more elements
A non-transitory, computer readable recording medium having embodied thereon a computer program to execute a method, wherein the method comprises:
- generating an audio stream and channel additional information, the audio stream obtained by downmixing a plurality of channels of MPEG audio data into a predetermined number of channels;
- analyzing each of the generated audio stream and preset HRTF data with respect to subbands;
- selecting and filtering the HRTF data to obtain one or more of the subbands of predetermined HRTF bands of the HRTF data analyzed with respect to the subbands;
- decoding the analyzed audio stream analyzed into a stream of multi-channel audio data with respect to the subbands according to spatial parameters;
- binaural-synthesizing the HRTF data of the obtained one or more subbands and the decoded multi-channel audio data;
- and
- subband-synthesizing a stream of audio data output with respect to the subbands.
4 more elements
A non-transitory, computer readable recording medium having embodied thereon a computer program to execute a method, wherein the method comprises:
- analyzing each of a generated audio stream and preset HRTF data with respect to subbands;
- selecting and filtering the HRTF data to obtain one or more of the subbands of predetermined HRTF bands of the HRTF data analyzed with respect to the subbands;
- decoding the analyzed audio stream analyzed into a stream of multi-channel audio data with respect to the subbands according to spatial parameters;
- binaural-synthesizing the HRTF data of the obtained subbands and the decoded multi-channel audio data;
- and
- subband-synthesizing a stream of audio data output with respect to the subbands.
3 more elements
A binaural decoding apparatus, comprising:
- a spatial synthesis unit to decode first and second audio streams into streams of multi-channel audio data with respect to subbands according to spatial parameters;
- a binaural synthesis unit comprising:
- multipliers to convolute the streams of multi-channel audio data with filtered HTRF data, and
- downmixers to downmix the convoluted streams of multi-channel audio data through a linear combination and output the convoluted streams of multi-channel audio data a result as left and right channel audio signals;
- a first QMF synthesis unit, by using at least one hardware processor, to subband-synthesize the left audio channel and to output the result to a left speaker;
- and
- a second QMF synthesis unit, by using at least one hardware processor, to subband-synthesize the right audio channel and to output the result to a right speaker.
4 more elements
A binaural decoding apparatus, comprising:
- a subband filter unit to select one or more of subbands of HRTF data;
- and
- a binaural synthesis unit, by using at least one hardware processor, to convolute an in-band stream of multi-channel audio data with the HRTF data of the selected one or more subbands, and to down-mix the multiplied in-band stream and an out-of-band stream of the multi-channel audio data into two-channel audio data.
A method of decoding a compressed audio stream into a stereo sound signal, comprising:
- dividing a compressed audio stream and head related transfer function (HRTF) data into subbands;
- decoding the divided audio stream into a stream of multi-channel audio data with respect to the subbands according to spatial parameters;
- and
- binaural-synthesizing the HRTF data of the subbands with the stream of multi-channel audio data of corresponding subbands.
1 more element
A method of decoding a compressed audio stream into a stereo sound signal, comprising:
- dividing a compressed audio stream into subbands;
- decoding the divided audio stream into a stream of multi-channel audio data with respect to the subbands according to spatial parameters;
- and
- binaural-synthesizing a predetermined filtered HRTF data with the stream of multi-channel audio data of corresponding subbands.
1 more element
A binaural decoding apparatus to binaurally decode a compressed audio stream, comprising:
- a subband analysis unit to analyze each of the compressed audio stream and head related transfer function (HRTF) data with respect to subbands;
- a subband filter unit to select one or more subbands of predetermined bands of the HRTF data analyzed in the subband analysis unit and to filter the HRTF data to obtain the selected subbands;
- a spatial and binaural synthesis unit to decode the audio stream analyzed in the subband analysis unit into a stream of multi-channel audio data with respect to the subbands according to spatial parameters, and binaural-synthesize the HRTF data of the subbands with the corresponding subbands of the stream of multi-channel audio data decoded in the spatial synthesis unit;
- and
- a subband synthesis unit, by using at least one hardware processor, to subband-synthesize audio data output with respect to the subbands from the binaural synthesis unit.
2 more elements
A method of generating a binaural signal, comprising:
- performing a QMF analysis on a mono downmixed signal to generate a QMF-domain mono downmixed signal;
- generating a QMF-domain binaural signal from the QMF-domain mono downmixed signal by a spatial synthesis using spatial parameters and the HRTF parameter;
- and
- generating a time-domain binaural signal by applying a QMF synthesis to the QMF-domain binaural signal.
1 more element
A method of generating a binaural signal, comprising:
- performing a QMF analysis on a stereo downmixed signal of an MPEG surround stream to generate a QMF-domain stereo downmixed signal;
- generating a QMF-domain binaural signal from the QMF-domain stereo downmixed signal by a spatial synthesis using spatial parameters and the HRTF parameter;
- and
- generating a time-domain binaural signal by applying a QMF synthesis to the QMF-domain binaural signal.
1 more element
Dependencies are inferred from the claim text.