Encoding and reproduction of three dimensional audio soundtracks
AssigneeDTS, Inc.
InventorsJean-Marc Jot, Zoran Fejzo, James D. Johnston
Life of this patent
Estimating the term…
Abstract
The present invention provides a novel end-to-end solution for creating, encoding, transmitting, decoding and reproducing spatial audio soundtracks. The provided soundtrack encoding format is compatible with legacy surround-sound encoding formats, so that soundtracks encoded in the new format may be decoded and reproduced on legacy playback equipment with no loss of quality compared to legacy formats.
Claims23
A method of encoding an audio soundtrack, comprising the steps of:
- receiving a base mix signal representing a physical sound;
- receiving at least one object audio signal, each object audio signal having at least one audio object component of the audio soundtrack;
- receiving at least one object mix cue stream, the object mix cue streams defining mixing parameters of the object audio signals;
- receiving at least one object render cue stream, the object render cue streams defining rendering parameters of the object audio signals;
- utilizing the object audio signals and the object mix cue streams to combine the audio object components with the base mix signal, thereby obtaining a downmix signal;
- and
- multiplexing the downmix signal, the object audio signal, the render cue streams, and the object cue streams to form a soundtrack data stream.
A method of decoding an audio soundtrack, representing a physical sound, comprising the steps of:
- receiving a soundtrack data stream, having:
- a downmix signal representing an audio scene;
- at least one object audio signal, the object audio signal having at least one audio object component of the audio soundtrack;
- at least one object mix cue stream, the object mix cue streams defining mixing parameters of the object audio signals;
- and
- at least one object render cue stream, the object render cue stream defining rendering parameters of the object audio signals;
- utilizing the object audio signals and the object mix cue streams to partially remove at least one audio object component from the downmix signal, thereby obtaining a residual downmix signal;
- applying a spatial format conversion to the residual downmix signal, thereby outputting a converted residual downmix signal having spatial parameters defining the spatial audio format;
- utilizing the object audio signals and the object render cue streams to derive at least one object rendering signal;
- and
- combining the converted residual downmix signal and the object rendering signal to obtain a soundtrack rendering signal.
An audio encoding processor, comprising:
- a receiver processor for receiving:
- a base mix signal representing a physical sound;
- at least one object audio signal, each object audio signal having at least one audio object component of the audio soundtrack;
- at least one object mix cue stream, the object mix cue streams defining mixing parameters of the object audio signals;
- and
- at least one object render cue stream, the object render cue streams defining rendering parameters of the object audio signals;
- a combining processor for combining the audio object components with the base mix signal based on the object audio signals and the object mix cue streams, the combining processor outputting a downmix signal;
- and
- a multiplexer processor for multiplexing the downmix signal, the object audio signal, the render cue streams, and the object cue streams to form a soundtrack data stream.
An audio decoding processor, comprising:
- a receiving processor for receiving:
- a downmix signal representing an audio scene;
- at least one object audio signal, the object audio signal having at least one audio object component of the audio scene;
- at least one object mix cue stream, the object mix cue streams defining mixing parameters of the object audio signals;
- and
- at least one object render cue stream, the object render cue stream defining rendering parameters of the object audio signals;
- an object audio processor for partially removing at least one audio object component from the downmix signal based on the object audio signals and the object mix cue streams, and outputting a residual downmix signal;
- a spatial format converter for applying a spatial format conversion to the residual downmix signal, thereby outputting a converted residual downmix signal having spatial parameters defining the spatial audio format;
- a rendering processor for processing the object audio signals and the object render cue streams to derive at least one object rendering signal;
- and
- a combining processor for combining the converted residual downmix signal and the object rendering signal to obtain a soundtrack rendering signal.
A method of decoding an audio soundtrack, representing a physical sound, comprising the steps of:
- receiving a soundtrack data stream, having:
- a downmix signal representing an audio scene;
- at least one object audio signal, the object audio signal having at least one audio object component of the audio soundtrack;
- and
- at least one object render cue stream, the object render cue stream defining rendering parameters of the object audio signals;
- utilizing the object audio signals and the object render cue streams to partially remove at least one audio object component from the downmix signal, thereby obtaining a residual downmix signal;
- applying a spatial format conversion to the residual downmix signal, thereby outputting a converted residual downmix signal having spatial parameters defining the spatial audio format;
- utilizing the object audio signals and the object render cue streams to derive at least one object rendering signal;
- and
- combining the converted residual downmix signal and the object rendering signal to obtain a soundtrack rendering signal.
Dependencies are inferred from the claim text.