# US 11,907,611 B2 · Deferred loudness adjustment for dynamic range control > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,907,611 B2 - Document ID: US11907611B2 - Status: Granted - Kind: B2 - Application number: 17/501,839 - Filed: 2021-10-14 - Published: 2022-05-12 - Granted: 2024-02-20 - Earliest claimed: 2020-11-10 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Frank Baumgarte - Web page: https://patentgrep.com/patent/US11907611B2 ## CPC - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G06F 3/162: {Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs} - H04R 3/04: for correcting frequency response - H04R 2430/01: Aspects of volume control, not necessarily automatic, in sound systems - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract A bitstream is obtained by a decoder side, that contains an encoded version of an audio signal and an instantaneous loudness sequence of the audio signal. The instantaneous loudness sequence has not been loudness normalized. A dynamic range control, DRC, gain sequence is produced by applying the instantaneous loudness sequence to a DRC characteristic, with loudness normalization. The DRC gain sequence is applied to the decoded audio signal. Other aspects are also described and claimed. ## Claims ### Claim 1 An audio decoder apparatus comprising: a processor; and memory having stored therein instructions that configure the processor to obtain a bitstream, the bitstream comprising: an encoded version of an audio signal, a first dynamic range control, DRC, gain sequence, that was determined by an encoder side process applying the audio signal to a first DRC characteristic, a loudness normalization gain that was applied by the encoder side process when determining the first DRC gain sequence, an index of the first DRC characteristic, wherein the index identifies or points to the first DRC characteristic, and a plurality of instances over time of an integrated loudness update. ### Claim 2 (depends on 1) The audio decoder apparatus of claim 1 wherein in response to the index having a first value the processor performs loudness normalization when applying DRC to the audio signal. ### Claim 3 (depends on 1) The audio decoder apparatus of claim 1 wherein the memory has stored therein instructions that configure the processor to perform loudness normalization after applying an inverse DRC characteristic to the first DRC gain sequence, by using the loudness normalization gain in the bitstream to compensate for or undo the loudness normalization gain that was applied by the encoder side process when determining the first DRC gain sequence. ### Claim 4 (depends on 1) The audio decoder apparatus of claim 1 wherein the memory has stored therein instructions that configure the processor to recover a loudness sequence by applying the first DRC gain sequence to an inverse of the first DRC characteristic, perform loudness normalization upon the recovered loudness sequence, produce a second DRC gain sequence by applying the recovered loudness sequence to a second DRC characteristic, and apply the second DRC gain sequence to the audio signal. ### Claim 5 (depends on 4) The audio decoder apparatus of claim 4 wherein the loudness normalization gain is in units of dB, and performing loudness normalization comprises combining the loudness normalization gain with the recovered loudness sequence and an instance of the integrated loudness update. ### Claim 6 (depends on 4) The audio decoder apparatus of claim 4 wherein performing the loudness normalization comprises shifting the second DRC characteristic along its input axis by an amount that is based on the loudness normalization gain and an instance of the integrated loudness update. ### Claim 7 (depends on 4) The audio decoder apparatus of claim 4 wherein the processor, for each instance of the integrated loudness update, calculates an update to a normalization gain as a difference between a DRC input loudness target and the instance of the integrated loudness update and performs the loudness normalization upon the recovered loudness sequence by adding the normalization gain to the recovered loudness sequence to produce a normalized loudness sequence, and wherein the processor produces the second DRC gain sequence by applying the normalized loudness sequence to the second DRC characteristic to produce the second DRC gain sequence. ### Claim 8 (depends on 1) The audio decoder apparatus of claim 1 wherein adjacent instances of the integrated loudness update are separated by one to ten seconds. ### Claim 9 (depends on 1) The audio decoder apparatus of claim 1 wherein the integrated loudness update represents a running average integrated loudness of the audio signal. ### Claim 10 (depends on 1) The audio decoder apparatus of claim 1 wherein the processor is configured to extract from the bitstream the index to the first DRC characteristic and use the extracted index to obtain an inverse of the first DRC characteristic, recover a loudness sequence by applying the first DRC gain sequence to the inverse of the first DRC characteristic, if the index has a first predefined value then for each instance of the integrated loudness update, calculate a normalization gain update as a difference between i) a DRC input loudness target and ii) a sum of the instance of the integrated loudness update and the loudness normalization gain, and add the normalization gain update to the recovered loudness sequence to produce a normalized loudness sequence, produce a second DRC gain sequence by applying the normalized loudness sequence to a second DRC characteristic, and apply the second DRC gain sequence to the audio signal. ### Claim 11 (depends on 10) The audio decoder apparatus of claim 10 wherein the processor is configured to, if the index has a second predefined value then produce the second DRC gain sequence by applying the recovered loudness sequence without loudness normalization, to the second DRC characteristic. ### Claim 12 An audio decoder apparatus comprising: a processor; and memory having stored therein instructions that configure the processor to obtain a bitstream, the bitstream comprising: an encoded version of an audio signal, a first dynamic range control, DRC, gain sequence, that was determined by an encoder side process applying the audio signal to a first DRC characteristic, an index of the first DRC characteristic, wherein the index identifies or points to the first DRC characteristic, a plurality of instances over time of an integrated loudness update, and a flag, wherein when the flag has a first value the bitstream contains an encoder side loudness normalization gain, or when the flag has a second value the bitstream does not contain the encoder side loudness normalization gain. ### Claim 13 (depends on 12) The audio decoder apparatus of claim 12 wherein in response to the flag having the first value, the processor applies DRC to the audio signal using a second DRC characteristic and with loudness normalization using i) the encoder side loudness normalization gain and ii) the plurality of instances of integrated loudness update. ### Claim 14 (depends on 12) The audio decoder apparatus of claim 12 wherein in response to i) the flag having the second value and ii) when the index has a first value, the processor applies DRC to the audio signal using a second DRC characteristic and with loudness normalization that uses the plurality of instances of integrated loudness update but without using the encoder side loudness normalization gain. ### Claim 15 (depends on 14) The audio decoder apparatus of claim 14 wherein in response to the index being a second value that is different than the first value, the processor applies DRC to the audio signal using the second DRC characteristic but without loudness normalization. ### Claim 16 An audio decoder apparatus comprising: a processor; and memory having stored therein instructions that configure the processor to obtain a bitstream, the bitstream comprising: an encoded version of an audio signal, a first dynamic range control, DRC, gain sequence, that was determined by an encoder side process applying the audio signal to a first DRC characteristic, an index of the first DRC characteristic, wherein the index identifies or points to the first DRC characteristic, a plurality of instances over time of integrated loudness update, and an encoder side DRC normalization gain; wherein the processor compensates for the encoder side DRC normalization gain when applying a decoder side DRC loudness normalization. ### Claim 17 (depends on 16) The audio decoder apparatus of claim 16 wherein the memory has stored therein instructions that configure the processor to compensate for the encoder side DRC normalization gain by undoing a loudness normalization gain that was applied by the encoder side process when determining the first DRC gain sequence. ### Claim 18 (depends on 16) The audio decoder apparatus of claim 16 wherein the bitstream comprises a flag, and when the flag has a first value, the first DRC gain sequence was determined by the encoder side process applying the audio signal to the first DRC characteristic with loudness normalization. ### Claim 19 (depends on 18) The audio decoder apparatus of claim 18 wherein when the flag has a second value, the first DRC gain sequence was determined by the encoder side process applying the audio signal to the first DRC characteristic without loudness normalization. ### Claim 20 A digital audio method comprising: obtaining a bitstream, the bitstream comprising an encoded version of an audio signal, a first dynamic range control, DRC, gain sequence, that was determined by an encoder side process applying the audio signal to a first DRC characteristic, an index of the first DRC characteristic, wherein the index identifies or points to the first DRC characteristic, and a plurality of instances over time of integrated loudness update; using the index to obtain an inverse DRC characteristic; performing loudness normalization after applying the inverse DRC characteristic to the first DRC gain sequence, to produce a normalized loudness sequence; applying the normalized loudness sequence to a second DRC characteristic to produce a second DRC gain sequence; and applying the second DRC gain sequence to the audio signal to produce compressed audio. ### Claim 21 (depends on 20) The method of claim 20 wherein applying the normalized loudness sequence comprises adjusting the normalized loudness sequence and then applying the adjusted normalized loudness sequence to the second DRC characteristic to produce the second DRC gain sequence.