# US 11,443,753 B2 · Audio stream dependency information > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,443,753 B2 - Document ID: US11443753B2 - Status: Granted - Kind: B2 - Application number: 16/762,557 - Filed: 2018-11-02 - Published: 2020-10-22 - Granted: 2022-09-13 - Earliest claimed: 2017-11-10 - Assignees: Nokia Technologies Oy - Applicants: Nokia Technologies Oy - Inventors: Lasse Juhani Laaksonen - Web page: https://patentgrep.com/patent/US11443753B2 ## CPC - G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing - G10L 19/167: {Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes} - H04S 2400/03: Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04S: STEREOPHONIC SYSTEMS ## Abstract There is disclosed inter alia an apparatus comprising means for receiving an audio format comprising a plurality of individual audio signal streams and metadata, wherein the metadata comprises a dependency field associated with each of the plurality of individual audio signal streams; means for determining that a dependency field associated with a first individual audio signal stream of the plurality of individual audio signal streams indicates that the first individual audio signal stream is related to a second individual audio signal stream of the plurality of individual audio signal streams; and means for encoding the first and second individual audio signal streams as a combined multichannel audio signal by an audio encoder. ## Claims ### Claim 1 An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to: receive an audio format comprising a plurality of individual audio signal streams and metadata, wherein the metadata comprises a dependency field associated with each of the plurality of individual audio signal streams, and wherein the dependency field indicates whether an individual audio signal stream of the plurality of individual audio signal streams and another individual audio signal stream of the plurality of individual audio signal streams were captured from one or more microphones in a same audio scene or captured from one or more microphones in different audio scenes; determine that a dependency field associated with a first individual audio signal stream of the plurality of individual audio signal streams indicates that the first individual audio signal stream and a second individual audio signal stream of the plurality of individual audio signal streams were captured from one or more microphones in the same audio scene; and in response to determining that the dependency field indicates that the first individual audio signal stream and the second individual audio signal stream of the plurality of individual audio signal streams were captured from the one or more microphones in the same audio scene, encode the first and second individual audio signal streams as a combined multichannel audio signal by an audio encoder. ### Claim 2 (depends on 1) The apparatus as claimed in claim 1, wherein the metadata further comprises a dependency field associated with a further individual audio signal stream of the plurality of audio signal streams, wherein the apparatus is further caused to: determine that the dependency field associated with the further individual audio signal stream indicates the further individual audio stream is independent from other individual audio signal streams of the plurality of individual audio signal streams; and encode the further individual audio stream as a single mono channel audio signal by the audio encoder. ### Claim 3 (depends on 1) The apparatus as claimed in claim 1, wherein the apparatus caused to determine that the dependency field associated with the first individual audio signal stream of the plurality of individual audio signal streams indicates the first individual audio signal stream and the second individual audio signal stream of the plurality of individual audio signal streams were captured from one or more microphones in a same audio scene is further caused to: determine that the dependency field associated with the first individual audio signal stream has an indicator indicating the second individual audio signal stream. ### Claim 4 (depends on 3) The apparatus as claimed in claim 3, wherein the metadata further comprises a numerical identifier for the first individual audio signal stream and a numerical identifier for the second individual audio signal stream. ### Claim 5 (depends on 4) The apparatus as claimed in claim 4, wherein the indicator indicating the second individual audio signal stream comprises an indication that the numerical identifier of the second individual audio signal stream is greater than the numerical identifier of the first individual audio signal stream. ### Claim 6 (depends on 5) The apparatus as claimed in claim 5, wherein the numerical identifier of the second individual audio signal stream has a value which is the value of the numerical identifier of the first audio signal stream increased by one. ### Claim 7 (depends on 4) The apparatus as claimed in claim 4, wherein the numerical identifier of the second individual audio signal stream is less than the numerical identifier of the first individual audio signal stream. ### Claim 8 (depends on 7) The apparatus as claimed in claim 7, wherein the numerical identifier of the second individual audio signal stream has a value which is the value of the numerical identifier of the first individual audio signal stream decreased by one. ### Claim 9 (depends on 4) The apparatus as claimed in claim 4, wherein the indicator indicating the second individual audio signal stream comprises the numerical identifier of the second individual audio signal stream. ### Claim 10 (depends on 1) The apparatus as claimed in claim 1, wherein the combined multichannel audio signal is a stereo audio signal. ### Claim 11 (depends on 1) The apparatus as claimed in claim 1, wherein the plurality of individual audio signal streams are captured by a plurality of microphones distributed in an audio scene. ### Claim 12 A method comprising: receiving an audio format comprising a plurality of individual audio signal streams and metadata, wherein the metadata comprises a dependency field associated with each of the plurality of individual audio signal streams, and wherein the dependency field indicates whether an individual audio signal stream of the plurality of individual audio signal streams and another individual audio signal stream of the plurality of individual audio signal streams were captured from one or more microphones in a same audio scene or captured from one or more microphones in different audio scenes; determining that a dependency field associated with a first individual audio signal stream of the plurality of individual audio signal streams indicates that the first individual audio signal stream and a second individual audio signal stream of the plurality of individual audio signal streams were captured from one or more microphones in the same audio scene; and in response to determining that the dependency field indicates that the first individual audio signal stream and the second individual audio signal stream of the plurality of individual audio signal streams were captured from the one or more microphones in the same audio scene, encoding the first and second individual audio signal streams as a combined multichannel audio signal by an audio encoder. ### Claim 13 (depends on 12) The method as claimed in claim 12, wherein the metadata further comprises a dependency field associated with a further individual audio signal stream of the plurality of audio signal streams, wherein the method further comprises: determining that the dependency field associated with the further individual audio signal stream indicates the further individual audio stream is independent from other individual audio signal streams of the plurality of individual audio signal streams; and encoding the further individual audio stream as a single mono channel audio signal by the audio encoder. ### Claim 14 (depends on 12) The method as claimed in claim 12, wherein determining that the dependency field associated with the first individual audio signal stream of the plurality of individual audio signal streams indicates that the first individual audio signal stream and the second individual audio signal stream of the plurality of individual audio signal streams were captured from one or more microphones in the same audio scene comprises: determining that the dependency field associated with the first individual audio signal stream has an indicator indicating the second individual audio signal stream. ### Claim 15 (depends on 14) The method as claimed in claim 14, wherein the metadata further comprises a numerical identifier of the first individual audio signal stream and a numerical identifier of the second individual audio signal stream. ### Claim 16 (depends on 15) The method as claimed in claim 15, wherein the indicator indicating the second individual audio signal stream comprises an indication that the numerical identifier of the second individual audio signal stream is greater than the numerical identifier of the first individual audio signal stream. ### Claim 17 (depends on 16) The method as claimed in claim 16, wherein the numerical identifier of the second individual audio signal stream has a value which is the value of the numerical identifier increased by one. ### Claim 18 (depends on 15) The method as claimed in claim 15, wherein the indicator indicating the second individual audio signal stream comprises an indication that the numerical identifier of the second individual audio signal stream is less than the numerical identifier of the first individual audio signal stream. ### Claim 19 (depends on 18) The apparatus as claimed in claim 18, wherein the numerical identifier of the second individual audio signal stream has a value which is the value of the numerical identifier decreased by one.