# US 2017/0249951 A1 · Transmission-agnostic presentation-based program loudness

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0249951 A1
- Document ID: US20170249951A1
- Status: Published application
- Kind: A1
- Application number: 15/517,482
- Filed: 2015-10-06
- Published: 2017-08-31
- Earliest claimed: 2014-10-10
- Assignees: Dolby Laboratories Licensing Corporation; Dolby International AB
- Applicants: Dolby Laboratories Licensing Corporation; Dolby International AB
- Inventors: Jeroen KOPPENS; Scott Gregory NORCROSS
- Web page: https://patentgrep.com/patent/US20170249951A1

## CPC

- G10L 19/167: {Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes}
- G10L 19/24: Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
- G10L 21/034: Automatic adjustment
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

This disclosure falls into the field of audio coding, in particular it is related to the field of providing a framework for providing loudness consistency among differing audio output signals. In particular, the disclosure relates to methods, computer program products and apparatus for encoding and decoding of audio data bitstreams in order to attain a desired loudness level of an output audio signal.

## Claims

### Claim 1

A method of processing a bitstream comprising a plurality of content substreams, each representing an audio signal, the method including:
from the bitstream, extracting one or more presentation data structures, each comprising a reference to a plurality of said content substreams, each presentation data structure further comprising a reference to loudness data included in a metadata substream, wherein said loudness data is dedicated to said presentation data structure and indicating what the loudness of the combination of the referenced plurality of content substreams will be when decoded;
receiving data indicating a selected presentation data structure out of said one or more presentation data structures, and a desired loudness level;
decoding the plurality of content substreams referenced by the selected presentation data structure; and
forming an output audio signal on the basis of the decoded content substreams,
the method further including processing the decoded plurality of content substreams or the output audio signal to attain said desired loudness level on the basis of the loudness data referenced by the selected presentation data structure.

### Claim 2 (depends on 1)

The method of claim 1, wherein the selected presentation data structure further references at least two mixing coefficients to be applied to the plurality of content substreams,
said forming an output audio signal further comprising additively mixing the decoded plurality of content substreams by applying the mixing coefficients.

### Claim 3 (depends on 2)

The method of claim 2, wherein the bitstream comprises a plurality of time frames, and wherein mixing coefficients referenced by the selected presentation data structure are independently assignable for each time frame.

### Claim 4 (depends on 2)

The method of claim 2, wherein the selected presentation data structure references, for each substream of the plurality of substreams, one mixing coefficient to be applied to the respective substreams.

### Claim 5 (depends on 1)

The method of claim 1, wherein the loudness data represent values of a loudness function relating to the application of gating to its audio input signal.

### Claim 6 (depends on 5)

The method of claim 5, wherein the loudness data represent values of a loudness function relating to such time segments of its audio input signal that represent dialog.

### Claim 7 (depends on 1)

The method of claim 1, wherein the presentation data structure further comprises a reference to dynamic range compression, DRC, data for the referenced plurality of content substreams,
the method further including processing the decoded plurality of content substreams or the output audio signal on the basis of the DRC data, wherein the processing comprises applying one or more DRC gains to the decoded plurality of content substreams or the output audio signal.

### Claim 8 (depends on 7)

The method of claim 7, wherein DRC data comprises at least one set of the one or more DRC gains;
wherein the DRC data comprises at least one compression curve and wherein the one or more DRC gains are obtained by:
calculating one or more loudness values of the referenced plurality of content substreams or the audio output signal using a predefined loudness function, and
mapping the one or more loudness values to DRC gains using the compression curve; or
wherein said referenced DRC data are comprised in said metadata substream.

### Claim at position 9

9-11. (canceled)

### Claim 12 (depends on 1)

The method of claim 1, wherein each of the decoded plurality of content substreams comprises substream-level loudness data descriptive of a loudness level of the content substream, and wherein said processing the decoded plurality of content substreams or the output audio signal further includes providing loudness consistency based on the loudness level of the content substream.

### Claim at position 11

13-14. (canceled)

### Claim 15 (depends on 1)

The method of claim 1, wherein the reference to at least one of said content substreams is a reference to at least one content substream group composed of a plurality of the content substreams.

### Claim 16 (depends on 2)

The method of claim 2, wherein the reference to at least one of said content substreams is a reference to a least one content substream group composed of a plurality of the content substreams, wherein the selected presentation data structure references, for a content substream group, a single mixing coefficient to be applied to each of said plurality of content substreams from which the substream group is composed.

### Claim 17 (depends on 1)

The method of claim 1, wherein the bitstream comprises a plurality of time frames, and wherein the data indicating the selected presentation data structure among the one or more presentation data structures are independently assignable for each time frame.

### Claim 18 (depends on 17)

The method of claim 17, wherein the method further comprises:
from the bitstream, and for a first of said plurality of time frames, extracting one or more presentation data structures, and
from the bitstream, and for a second of said plurality of time frames, extracting one or more presentation data structures different from said the one or more presentation data structures extracted from the first of said plurality of time frames,
and wherein the data indicating the selected presentation data structure indicates a selected presentation data structure for the time frame for which it is assigned.

### Claim 19 (depends on 1)

The method of claim 1, wherein, out of the plurality of content substreams comprised in the bitstream, only the plurality of content substreams referenced by the selected presentation data structure are decoded; and/or
wherein the bitstream comprises two or more separate bitstreams, each comprising at least one of said plurality of content substreams, wherein the step of decoding the plurality of content substreams referenced by the selected presentation data structure comprises:
separately decoding, for each specific bitstream of the two or more separate bitstreams, the content substream(s) out of the referenced content substreams comprised in the specific bitstream.

### Claim 20

(canceled)

### Claim 21

A decoder for processing a bitstream comprising a plurality of content substreams, each representing an audio signal, the decoder comprising:
a receiving component configured for receiving the bitstream;
a demultiplexer configured for extracting, from the bitstream, one or more presentation data structures, each comprising a reference to a plurality of said content substreams and further comprising a reference to loudness data included in a metadata substream, wherein said loudness data is dedicated to said presentation data structure and indicating what the loudness of the combination of the referenced plurality of content substreams will be when decoded;
a playback state component configured for receiving data indicating a selected presentation data structure among the one or more presentation data structures, and a desired loudness level; and
a mixing component configured for decoding the plurality of content substreams referenced by the selected presentation data structure, and for forming an output audio signal on the basis of the decoded content substreams,
wherein the mixing component is further configured for processing the decoded plurality of content substreams or the output audio signal to attain said desired loudness level on the basis of the loudness data reference by the selected presentation data structure.

### Claim 22

An audio encoding method, including:
receiving a plurality of content substreams representing respective audio signals;
defining one or more presentation data structures, each referring to a plurality of said plurality of content substreams;
for each of the one or more presentation data structures, applying a predefined loudness function to obtain loudness data indicating what the loudness of the combination of the referenced plurality of content substreams will be when decoded by a decoder, and including a reference to the loudness data from the presentation data structure; and
forming a bitstream comprising said plurality of content substreams, said one or more presentation data structures and the loudness data referenced by the presentation data structures.

### Claim 23 (depends on 22)

The method of claim 22, further comprising the steps of:
for each of the one or more presentation data structures, determining dynamic range compression, DRC, data for the referenced plurality of content substreams, wherein the DRC data quantify at least one desired compression curve or at least one set of DRC gains, and
including said DRC data in the bitstream; or
for each of the plurality of content substreams, applying the predefined loudness function to obtain substream-level loudness data of the content substream, and
including said substream-level loudness data in the bitstream.

### Claim at position 21

24-27. (canceled)

### Claim 28

An audio encoder, comprising:
a loudness component configured to apply a predefined loudness function to obtain loudness data indicating what the loudness of a combination of a plurality of content substreams representing respective audio signals will be when decoded by a decoder;
a presentation data component configured to define one or more presentation data structures, each comprising a reference to a plurality of content substreams out of a plurality of content substreams and a reference to loudness data what the loudness of a combination of the referenced content substreams will be when decoded by a decoder; and
a multiplexing component configured to form a bitstream comprising said plurality of content substreams, said one or more presentation data structures and the loudness data referenced by the said one or more presentation data structures.

### Claim 29 (depends on 1)

A non-transitory computer-readable storage medium comprising a sequence of instructions, wherein the instructions, when executed by an audio signal processing device, cause the device to perform the method of claim 1.

### Claim 30 (depends on 22)

A non-transitory computer-readable storage medium comprising a sequence of instructions, wherein the instructions, when executed by an audio signal processing device, cause the device to perform the method of claim 22.
