# US 12,113,845 B2 · Techniques for signaling audio mixing gain in teleconferencing and telepresence for remote terminals > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,113,845 B2 - Document ID: US12113845B2 - Status: Granted - Kind: B2 - Application number: 17/692,840 - Filed: 2022-03-11 - Published: 2022-09-15 - Granted: 2024-10-08 - Earliest claimed: 2021-03-12 - Assignees: Tencent America LLC - Applicants: Tencent America LLC - Inventors: Rohit Abhishek; Iraj Sodagar - Web page: https://patentgrep.com/patent/US12113845B2 ## CPC - H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) - H04L 65/70: Media network packetisation - H04L 65/1104: Session initiation protocol [SIP] - H04L 65/4038: with floor control - H04L 65/65: Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP] - H04L 65/75: Media network packet handling - H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)} - H04L 65/765: {intermediate} - H04M 3/568: {audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants (echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30)} - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) ## Abstract A method and system for audio mixing in a teleconference using a Session Description Protocol (SDP) and Real-time Transport Protocol (RTP) signaling of audio mixing gain is provided. The method includes receiving an input audio stream from a 360-degree video/audio stream that includes an audio mixing gain which includes audio gain from the input audio stream and audio gain from overlay audio streams, declaring a RTP header extension for the input audio stream using the SDP, the RTP header extension, and signaling the audio mixing gain based on a single attribute of the SDP using the RTP header extension. An element of the RTP header extension may include an element identifier, a length of an extension element, and a magnitude of the audio mixing gain of the RTP header extension. The RTP header extension may use a one-byte or two-byte header extension format which is declared using the SDP. ## Claims ### Claim 1 A method of signaling audio mixing gain in a teleconference using a Session Description Protocol (SDP), the method comprising: receiving an input audio stream, from a 360-degree stream, including an audio mixing gain; signaling the audio mixing gain in an SDP offer; wherein the SDP offer comprises a first audio gain, an audio identifier associated with a first audio in the input audio stream, a second audio gain, and an overlay id associated with an overlay audio in the input audio stream; and based on a receiver accepting the SDP offer and based on a change in the audio mixing gain, signaling only an updated audio gain instead of signaling an entire media line. ### Claim 2 (depends on 1) The method of claim 1, wherein an Augmented Backus-Naur Form (ABNF) for the SDP is used to describe the audio mixing gain. ### Claim 3 (depends on 1) The method of claim 1, wherein a one-byte RTP header extension format is used for signaling the audio mixing gain. ### Claim 4 (depends on 1) The method of claim 1, wherein a two-byte RTP header extension format is used for signaling the audio mixing gain. ### Claim 5 (depends on 1) The method of claim 1, wherein a Uniform Resource Identifier (URI) in the SDP is used to declare a RTP header extension, and wherein the RTP header extension is only present in a first packet of the input audio stream. ### Claim 6 (depends on 1) The method of claim 1, further comprising updating the audio mixing gain, wherein the updating has a frequency less than a predetermined amount. ### Claim 7 (depends on 6) The method of claim 6, wherein a RTP header extension is repeated when the audio mixing gain is updated. ### Claim 8 (depends on 1) The method of claim 1, further comprising signaling an array of audio mixing gains from the input audio stream and the one or more overlay audio streams. ### Claim 9 A system for signaling audio mixing gain in a teleconference using a Session Description Protocol (SDP), the system comprising: at least one memory storing instructions; and at least one processor configured to execute the instructions to: receive an input audio stream, from a 360-degree stream, the input audio stream including an audio mixing gain; signal the audio mixing gain in an SDP offer; wherein the SDP offer comprises a first audio gain, an audio identifier associated with a first audio in the input audio stream, a second audio gain, and an overlay id associated with an overlay audio in the input audio stream; and based on a receiver accepting the SDP offer and based on a change in the audio mixing gain, signal only an updated audio gain instead of signaling an entire media line. ### Claim 10 (depends on 9) The system of claim 9, wherein an Augmented Backus-Naur Form (ABNF) for the SDP is used to describe the audio mixing gain. ### Claim 11 (depends on 9) The system of claim 9, wherein a one-byte RTP header extension format is used for signaling the audio mixing gain or a two-byte RTP header extension format is used for signaling the audio mixing gain. ### Claim 12 (depends on 9) The system of claim 9, wherein a Uniform Resource Identifier (URI) in the SDP is used to declare a RTP header extension, and wherein the RTP header extension is only present in a first packet of the input audio stream. ### Claim 13 (depends on 9) The system of claim 9, wherein the processor is further configured to execute the instructions to update the audio mixing gain, wherein the updating has a frequency less than a predetermined amount. ### Claim 14 (depends on 9) The system of claim 9, wherein the processor is further configured to execute the instructions to signal an array of audio mixing gains from the input audio stream and one or more overlay audio streams. ### Claim 15 A non-transitory computer readable medium for signaling audio mixing gain in a teleconference using a Session Description Protocol (SDP) storing instructions that, when executed by at least one processor, cause the at least one processor to: receive an input audio stream, from a 360-degree stream, the input audio stream including an audio mixing gain; signal the audio mixing gain in an SDP offer; wherein the SDP offer comprises a first audio gain, an audio identifier associated with a first audio in the input audio stream, a second audio gain, and an overlay id associated with an overlay audio in the input audio stream; and based on a receiver accepting the SDP offer and based on a change in the audio mixing gain, signal only an updated audio gain instead of signaling an entire media line. ### Claim 16 (depends on 15) The non-transitory storage medium of claim 15, wherein an Augmented Backus-Naur Form (ABNF) for the SDP is used to describe the audio mixing gain. ### Claim 17 (depends on 15) The non-transitory storage medium of claim 15, wherein a one-byte RTP header extension format is used for signaling the audio mixing gain or a two-byte RTP header extension format is used for signaling the audio mixing gain. ### Claim 18 (depends on 15) The non-transitory storage medium of claim 15, wherein a Uniform Resource Identifier (URI) in the SDP is used to declare a RTP header extension, and wherein the RTP header extension is only present in a first packet of the input audio stream. ### Claim 19 (depends on 15) The non-transitory storage medium of claim 15, wherein the instructions, when executed, cause the at least one processor to update the audio mixing gain, wherein the updating has a frequency less than a predetermined amount. ### Claim 20 (depends on 15) The non-transitory storage medium of claim 15, wherein the instructions, when executed, cause the at least one processor to signal an array of audio mixing gains from the input audio stream and one or more overlay audio streams.