# US 9,521,501 B2 · Loudness adjustment for downmixed audio content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,521,501 B2 - Document ID: US9521501B2 - Status: Granted - Kind: B2 - Application number: 14/916,522 - Filed: 2014-09-09 - Published: 2016-07-28 - Granted: 2016-12-13 - Earliest claimed: 2013-09-12 - Assignees: Dolby Laboratories Licensing Corporation; Dolby International AB - Applicants: Dolby Laboratories Licensing Corporation; Dolby International AB - Inventors: Michael Ward; Jeffrey Riedmiller; Scott Gregory Norcross; Alexander Groeschel - Web page: https://patentgrep.com/patent/US9521501B2 ## CPC - H04S 7/30: {Control circuits for electronic adaptation of the sound field} - G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing - G10L 21/0324: Details of processing therefor - H03G 7/007: {of digital or coded signals} - H04S 1/002: {Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution (control circuits for electronic adaptation of the sound field H04S7/30)} - H04S 1/007: {in which the audio signals are in digital form (data reduction aspects thereof based on psychoacoustics G10L19/02)} - H04S 2400/03: Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence) - H04S 2400/13: Aspects of volume control, not necessarily automatic, in stereophonic sound systems - H04S: STEREOPHONIC SYSTEMS - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H03G: CONTROL OF AMPLIFICATION ## Abstract Audio content coded for a reference speaker configuration is downmixed to downmix audio content coded for a specific speaker configuration. One or more gain adjustments are performed on individual portions of the downmix audio content coded for the specific speaker configuration. Loudness measurements are then performed on the individual portions of the downmix audio content. An audio signal that comprises the audio content coded for the reference speaker configuration and downmix loudness metadata is generated. The downmix loudness metadata is created based at least in part on the loudness measurements on the individual portions of the downmix audio content. ## Claims ### Claim 1 A method, comprising: generating audio content coded for a reference speaker configuration; downmixing the audio content coded for the reference speaker configuration to downmix audio content coded for a specific speaker configuration; performing one or more gain adjustments on individual portions of the downmix audio content coded for the specific speaker configuration, wherein the one or more gain adjustments use different gain adjustment parameter values for at least two different portions of the individual portions of the downmixed audio content; performing loudness measurements on the individual portions of the downmix audio content; and generating an audio signal that comprises the audio content coded for the reference speaker configuration and downmix loudness metadata created based at least in part on the loudness measurements on the individual portions of the downmix audio content; wherein the method is performed by one or more computing devices and the one or more gain adjustments comprise at least one gain adjustment relating to one or more of dialogue normalization, dynamic range compression, or fixed attenuation to protect against downmix overload. ### Claim 2 (depends on 1) The method of claim 1, wherein the reference speaker configuration is a surround speaker configuration, and wherein the specific speaker configuration is a two-channel configuration. ### Claim 3 (depends on 1) The method of claim 1, wherein the audio content coded for the reference speaker configuration is downmixed to the downmix audio content coded for the specific speaker configuration based on one or more downmix equations. ### Claim 4 (depends on 1) The method of claim 1, wherein the downmix loudness metadata comprises one or more sets of downmix loudness parameters, each set of the two or more sets of downmix loudness parameters corresponding to an individual type of downmixing operation among one or more types of downmix operations to which the one or more sets of downmix loudness parameters correspond. ### Claim 5 (depends on 4) The method of claim 4, wherein the one or more types of downmixing operations comprise at least one of LtRt dowmixing operation or LoRo downmixing operation. ### Claim 6 (depends on 1) The method of claim 1, wherein downmixing the audio content coded for the reference speaker configuration to downmix audio content coded for a specific speaker configuration is based on one or more types of downmixing operations, and wherein performing loudness measurements on the individual portions of the downmix audio content includes performing loudness measurements on the individual portions of the downmix audio content relating to each of the one or more types of downmixing operations. ### Claim 7 (depends on 1) The method of claim 1, wherein the loudness measurements on the individual portions of the downmix audio content are performed after the one or more gain adjustments are applied to the individual portions of the downmix audio content. ### Claim 8 (depends on 1) The method of claim 1, wherein the at least two different portions of the individual portions of the audio content represent audio content portions at least two different times. ### Claim 9 (depends on 1) The method of claim 1, further comprising preventing the downmixed audio content for the specific speaker configuration from being encoded in the audio signal. ### Claim 10 A method, comprising: receiving, by an audio decoder operating with a specific speaker configuration, an audio signal that comprises audio content coded for a reference speaker configuration and downmix loudness metadata; downmixing the audio content coded for the reference speaker configuration to downmix audio content coded for the specific speaker configuration; performing one or more gain adjustments on individual portions of the downmix audio content coded for the specific speaker configuration, the one or more gain adjustment not being based on the downmix loudness metadata, wherein the one or more gain adjustments use different gain adjustment parameter values for at least two different portions of the individual portions of the downmixed audio content; and performing one or more additional gain adjustments on the individual portions of the downmix audio content coded for the specific speaker configuration, the one or more additional gain adjustment being based on the downmix loudness metadata; wherein the method is performed by one or more computing devices and the one or more gain adjustments comprise at least one gain adjustment relating to one or more of dialogue normalization, dynamic range compression, or fixed attenuation to protect against downmix overload. ### Claim 11 (depends on 10) The method of claim 10, wherein the reference speaker configuration is a surround speaker configuration, and wherein the specific speaker configuration is a two-channel configuration. ### Claim 12 (depends on 10) The method of claim 10, further comprising: determining a specific type of downmixing operation based on one or more selection factors; applying the specific type of downmixing operation in downmixing the audio content coded for the reference speaker configuration to the downmix audio content coded for the specific speaker configuration; determining, from one or more sets of downmixing loudness parameters in the downmix loudness metadata, a specific set of downmix loudness parameters to which the specific type of downmixing operation correspond; and performing the one or more additional gain adjustments on the individual portions of the downmix audio content coded for the specific speaker configuration based at least in part on the specific set of downmix loudness parameters. ### Claim 13 (depends on 10) The method of claim 10, wherein the audio content coded for the reference speaker configuration is downmixed to the downmix audio content coded for the specific speaker configuration based on one or more downmix equations, and wherein the one or more downmix equations are the same downmix equation used by an audio encoder that generates the audio signal. ### Claim 14 (depends on 10) The method of claim 10, wherein the one or more gain adjustments represent a specific set of gain adjustments determined from one or more of a set of null gains, sets of gain adjustments including gain adjustments relating to dynamic range compression (DRC), sets of gain adjustments excluding gain adjustments relating to DRC, sets of gain adjustments including gain adjustments relating to dialog normalization, sets of gain adjustments excluding gain adjustments relating to dialog normalization, or sets of gain adjustments including gain adjustments relating to both DRC and dialog normalization. ### Claim 15 (depends on 10) The method of claim 10, wherein the downmix loudness metadata represents a part of overall audio metadata encoded in the audio signal. ### Claim 16 (depends on 10) The method of claim 10, wherein the downmix loudness metadata comprises a data field to indicate a downmix loudness offset, and wherein the one or more additional gain adjustments are made based at least in part on the downmix loudness offset. ### Claim 17 (depends on 10) The method of claim 10, wherein the one or more gain adjustments do not produce an expected loudness in a downmix sound output for at least one individual portion of the one or more individual portions of the downmix audio content, wherein the one or more additional gain adjustments are performed to produce an expected loudness in a downmix sound output for the at least one individual portion of the one or more individual portions of the downmix audio content. ### Claim 18 (depends on 10) The method of claim 10, wherein the one or more gain adjustments correspond to one or more gain adjustments performed by an upstream audio encoder, before generating the downmix loudness metadata by the upstream audio encoder. ### Claim 19 (depends on 1) A media processing system configured to perform the method recited in claim 1. ### Claim 20 (depends on 1) An apparatus comprising a processor and configured to perform the method recited in claim 1. ### Claim 21 (depends on 1) A non-transitory computer readable storage medium, comprising software instructions, which when executed by one or more processors cause performance of the method recited in claim 1.