# US 11,910,176 B2 · Apparatus and method for low delay object metadata coding > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,910,176 B2 - Document ID: US11910176B2 - Status: Granted - Kind: B2 - Application number: 17/728,804 - Filed: 2022-04-25 - Published: 2022-10-13 - Granted: 2024-02-20 - Earliest claimed: 2013-07-22 - Assignees: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V. - Applicants: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V. - Inventors: Christian Borss; Christian Ertel; Johannes Hilpert - Web page: https://patentgrep.com/patent/US11910176B2 ## CPC - H04S 5/005: {of the pseudo five- or more-channel type, e.g. virtual surround} - G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing - H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)} - H04S 3/02: of the matrix type, i.e. in which input signals are combined algebraically, e.g. after having been phase shifted with respect to each other - H04S 2400/03: Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence) - H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) - H04S 2420/03: Application of parametric coding in stereophonic audio systems - H04S: STEREOPHONIC SYSTEMS - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract An apparatus for generating one or more audio channels. The apparatus comprises a metadata decoder for generating one or more reconstructed metadata signals from one or more processed metadata signals depending on a control signal, wherein each of the one or more reconstructed metadata signals indicates information associated with an audio signal of one or more audio signals, wherein the metadata decoder is configured to generate the one or more reconstructed metadata signals by determining a plurality of reconstructed metadata samples for each of the one or more reconstructed metadata signals. Moreover, the apparatus comprises an audio channel generator for generating the one or more audio channels depending on the one or more audio signals and depending on the one or more reconstructed metadata signals. ## Claims ### Claim 1 An apparatus for generating one or more audio channels, wherein the apparatus comprises: a metadata decoder for generating one or more reconstructed metadata signals from one or more processed metadata signals depending on a control signal, wherein each of the one or more reconstructed metadata signals indicates information associated with an audio signal of one or more audio signals, wherein the metadata decoder is configured to generate the one or more reconstructed metadata signals by determining a plurality of reconstructed metadata samples for each of the one or more reconstructed metadata signals, and an audio channel generator for generating the one or more audio channels depending on the one or more audio signals and depending on the one or more reconstructed metadata signals, wherein the metadata decoder is configured to receive a plurality of processed metadata samples of each of the one or more processed metadata signals, wherein the metadata decoder is configured to receive the control signal, wherein the metadata decoder is configured to determine each reconstructed metadata sample of the plurality of reconstructed metadata samples of each reconstructed metadata signal of the one or more reconstructed metadata signals, so that, when the control signal indicates a first state, said reconstructed metadata sample is a sum of one of the processed metadata samples of one of the one or more processed metadata signals and of another already generated reconstructed metadata sample of said reconstructed metadata signal, and so that, when the control signal indicates a second state being different from the first state, said reconstructed metadata sample is said one of the processed metadata samples of said one of the one or more processed metadata signals. ### Claim 2 (depends on 1) An apparatus according to claim 1, wherein the metadata decoder is configured to receive two or more of the processed metadata signals, and is configured to generate two or more of the reconstructed metadata signals, wherein the metadata decoder comprises two or more metadata decoder subunits, wherein each of the two or more metadata decoder subunits comprises an adder and a selector, wherein each of the two or more metadata decoder subunits is configured to receive the plurality of processed metadata samples of one of the two or more processed metadata signals, and is configured to generate one of the two or more reconstructed metadata signals, wherein the adder of said metadata decoder subunit is configured to add one of the processed metadata samples of said one of the two or more processed metadata signals and another already generated reconstructed metadata sample of said one of the two or more reconstructed metadata signals, to acquire a sum value, and wherein the selector of said metadata decoder subunit is configured to receive said one of the processed metadata samples, said sum value and the control signal, and wherein said selector is configured to determine one of the plurality of metadata samples of said reconstructed metadata signal so that, when the control signal indicates the first state, said reconstructed metadata sample is the sum value, and so that, when the control signal indicates the second state, said reconstructed metadata sample is said one of the processed metadata samples. ### Claim 3 (depends on 1) An apparatus according to claim 1, wherein at least one of the one or more reconstructed metadata signals indicates position information on one of the one or more audio signals, and wherein the audio channel generator is configured to generate at least one of the one or more audio channels depending on said one of the one or more audio signals and depending on said position information. ### Claim 4 (depends on 1) An apparatus according to claim 1, wherein at least one of the one or more reconstructed metadata signals indicates a volume of one of the one or more audio signals, and wherein the audio channel generator is configured to generate at least one of the one or more audio channels depending on said one of the one or more audio signals and depending on said volume. ### Claim 5 An apparatus for generating encoded audio information comprising one or more encoded audio signals and one or more processed metadata signals, wherein the apparatus comprises: a metadata encoder for receiving one or more original metadata signals and for determining the one or more processed metadata signals, wherein each of the one or more original metadata signals comprises a plurality of original metadata samples, wherein the original metadata samples of each of the one or more original metadata signals indicate information associated with an audio signal of one or more audio signals, and an audio encoder for encoding the one or more audio signals to acquire the one or more encoded audio signals, wherein the metadata encoder is configured to determine each processed metadata sample of a plurality of processed metadata samples of each processed metadata signal of the one or more processed metadata signals, so that, when a control signal indicates a first state, said processed metadata sample indicates a difference or a quantized difference between one of the plurality of original metadata samples of one of the one or more original metadata signals and of another already generated processed metadata sample of said processed metadata signal, and so that, when the control signal indicates a second state being different from the first state, said processed metadata sample is said one of the original metadata samples of said one of the one or more original metadata signals, or is a quantized representation said one of the original metadata samples. ### Claim 6 (depends on 5) An apparatus according to claim 5, wherein the metadata encoder is configured to receive two or more of the original metadata signals, and is configured to generate two or more of the processed metadata signals, wherein the metadata encoder comprises two or more Differential Pulse Code Modulation (DPCM) Encoders, wherein each of the two or more DPCM Encoders is configured to determine a difference or a quantized difference between one of the original metadata samples of one of the two or more original metadata signals and another already generated processed metadata sample of one of the two or more processed metadata signals, to acquire a difference sample, and wherein metadata encoder further comprises a selector being configured to determine one of the plurality of processed metadata samples of said processed metadata signal so that, when the control signal indicates the first state, said processed metadata sample is the difference sample, and so that, when the control signal indicates the second state, said processed metadata sample is said one of the original metadata samples or a quantized representation of said one of the original metadata samples. ### Claim 7 (depends on 5) An apparatus according to claim 5, wherein at least one of the one or more original metadata signals indicates position information on one of the one or more audio signals, and wherein the metadata encoder is configured to generate at least one of the one or more processed metadata signals depending on said at least one of the one or more original metadata signals which indicates said position information. ### Claim 8 (depends on 5) An apparatus according to claim 5, wherein at least one of the one or more original metadata signals indicates a volume of one of the one or more audio signals, and wherein the metadata encoder is configured to generate at least one of the one or more processed metadata signals depending on said at least one of the one or more original metadata signals which indicates said volume. ### Claim 9 (depends on 5) An apparatus according to claim 5, wherein the metadata encoder is configured to encode each of the processed metadata samples of one of the one or more processed metadata signals with a first number of bits when the control signal indicates the first state, and with a second number of bits when the control signal indicates the second state, wherein the first number of bits is smaller than the second number of bits. ### Claim 10 (depends on 1, 5) A system, comprising: an apparatus according to claim 5 for generating encoded audio information comprising one or more encoded audio signals and one or more processed metadata signals, and an apparatus according to claim 1 for receiving the one or more encoded audio signals and the one or more processed metadata signals, and for generating one or more audio channels depending on the one or more encoded audio signals and depending on the one or more processed metadata signals. ### Claim 11 A method for generating one or more audio channels, wherein the method comprises: generating one or more reconstructed metadata signals from one or more processed metadata signals depending on a control signal, wherein each of the one or more reconstructed metadata signals indicates information associated with an audio signal of one or more audio signals, wherein generating the one or more reconstructed metadata signals is conducted by determining a plurality of reconstructed metadata samples for each of the one or more reconstructed metadata signals, and generating the one or more audio channels depending on the one or more audio signals and depending on the one or more reconstructed metadata signals, wherein generating the one or more reconstructed metadata signals is conducted by receiving a plurality of processed metadata samples of each of the one or more processed metadata signals, by receiving the control signal, and by determining each reconstructed metadata sample of the plurality of reconstructed metadata samples of each reconstructed metadata signal of the one or more reconstructed metadata signals, so that, when the control signal indicates a first state, said reconstructed metadata sample is a sum of one of the processed metadata samples of one of the one or more processed metadata signals and of another already generated reconstructed metadata sample of said reconstructed metadata signal, and so that, when the control signal indicates a second state being different from the first state, said reconstructed metadata sample is said one of the processed metadata samples of said one of the one or more processed metadata signals. ### Claim 12 A method for generating encoded audio information comprising one or more encoded audio signals and one or more processed metadata signals, wherein the method comprises: receiving one or more original metadata signals, determining the one or more processed metadata signals, and encoding one or more audio signals to acquire the one or more encoded audio signals, wherein each of the one or more original metadata signals comprises a plurality of original metadata samples, wherein the original metadata samples of each of the one or more original metadata signals indicate information associated with an audio signal of the one or more audio signals, and wherein determining the one or more processed metadata signals comprises determining each processed metadata sample of a plurality of processed metadata samples of each processed metadata signal of the one or more processed metadata signals, so that, when a control signal indicates a first state, said processed metadata sample indicates a difference or a quantized difference between one of the plurality of original metadata samples of one of the one or more original metadata signals and of another already generated processed metadata sample of said processed metadata signal, and so that, when the control signal indicates a second state being different from the first state, said processed metadata sample is said one of the original metadata samples of said one of the one or more original metadata signals, or is a quantized representation said one of the original metadata samples. ### Claim 13 Non-transitory digital storage medium having a computer program stored thereon to perform a method for generating one or more audio channels, wherein the method comprises: generating one or more reconstructed metadata signals from one or more processed metadata signals depending on a control signal, wherein each of the one or more reconstructed metadata signals indicates information associated with an audio signal of one or more audio signals, wherein generating the one or more reconstructed metadata signals is conducted by determining a plurality of reconstructed metadata samples for each of the one or more reconstructed metadata signals, and generating the one or more audio channels depending on the one or more audio signals and depending on the one or more reconstructed metadata signals, wherein generating the one or more reconstructed metadata signals is conducted by receiving a plurality of processed metadata samples of each of the one or more processed metadata signals, by receiving the control signal, and by determining each reconstructed metadata sample of the plurality of reconstructed metadata samples of each reconstructed metadata signal of the one or more reconstructed metadata signals, so that, when the control signal indicates a first state, said reconstructed metadata sample is a sum of one of the processed metadata samples of one of the one or more processed metadata signals and of another already generated reconstructed metadata sample of said reconstructed metadata signal, and so that, when the control signal indicates a second state being different from the first state, said reconstructed metadata sample is said one of the processed metadata samples of said one of the one or more processed metadata signals, when said computer program is run by a computer. ### Claim 14 Non-transitory digital storage medium having a computer program stored thereon to perform a method for generating encoded audio information comprising one or more encoded audio signals and one or more processed metadata signals, wherein the method comprises: receiving one or more original metadata signals, determining the one or more processed metadata signals, and encoding one or more audio signals to acquire the one or more encoded audio signals, wherein each of the one or more original metadata signals comprises a plurality of original metadata samples, wherein the original metadata samples of each of the one or more original metadata signals indicate information associated with an audio signal of the one or more audio signals, and wherein determining the one or more processed metadata signals comprises determining each processed metadata sample of a plurality of processed metadata samples of each processed metadata signal of the one or more processed metadata signals, so that, when a control signal indicates a first state, said processed metadata sample indicates a difference or a quantized difference between one of the plurality of original metadata samples of one of the one or more original metadata signals and of another already generated processed metadata sample of said processed metadata signal, and so that, when the control signal indicates a second state being different from the first state, said processed metadata sample is said one of the original metadata samples of said one of the one or more original metadata signals, or is a quantized representation said one of the original metadata samples, when said computer program is run by a computer.