# US 2022/0277755 A1 · Methods and devices for generation and processing of modified audio bitstreams

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0277755 A1
- Document ID: US20220277755A1
- Status: Published application
- Kind: A1
- Application number: 17/635,183
- Filed: 2020-08-13
- Published: 2022-09-01
- Earliest claimed: 2019-08-15
- Assignees: Dolby International AB; Dolby Laboratories Licensing Corporation
- Applicants: Dolby International AB; Dolby Laboratories Licensing Corporation
- Inventors: Christof Fersch; Daniel Fischer; Leon Terentiv; Gregory John McGarry
- Web page: https://patentgrep.com/patent/US20220277755A1

## CPC

- G10L 19/083: the excitation function being an excitation gain (G10L25/90 takes precedence)
- G10L 19/167: {Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes}
- H04L 65/1069: Session establishment or de-establishment
- H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)}
- H04L 65/80: Responding to QoS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Described herein is a method for generating a modified bitstream on a source device, wherein the method includes the steps of: a) receiving, by a receiver, a bitstream including coded media data; b) generating, by an embedder, payload of additional media data and embedding the payload in the bitstream for obtaining, as an output from the embedder, a modified bitstream including the coded media data and the payload of the additional media data; and c) outputting the modified bitstream to a sink device. Described is further a method for processing said modified bitstream on a sink device. Described are moreover a respective source device and sink device as well as a system of a source device and a sink device and respective computer program products.

## Claims

### Claim 1

A method for generating a modified bitstream in MPEG-4 audio format by a source device, the source device comprising a receiver and an embedder, wherein the method includes the steps of:
a) receiving, by the receiver, a bitstream including coded media data;
b) generating, by the embedder, payload of additional uncompressed PCM audio data and embedding the payload in the bitstream for obtaining, as an output from the embedder, a modified bitstream including the coded media data and the payload of the additional uncompressed PCM audio data, wherein the generated payload is embedded in the bitstream by transporting the payload in the modified bitstream via an MPEG-4 audio bitstream extension mechanism, wherein the MPEG-4 audio bitstream extension mechanism is a data stream element (DSE); and
c) outputting the modified bitstream to the sink device.

### Claim 2 (depends on 1)

Method according to claim 1, wherein step b) further includes generating information on the additional uncompressed PCM audio data and embedding the information in the bitstream.

### Claim 3 (depends on 2)

Method according to claim 2, wherein the generated information includes one or more of information on a configuration of the additional uncompressed PCM audio data, information on a presence of the additional uncompressed PCM audio data in the modified bitstream, information on a default loudness value, information on a value for delay alignment, information on delay adaption, information on panning and information on a type of the additional data uncompressed PCM audio data.

### Claim 4 (depends on 1)

Method according to claim 1, wherein step b) further includes generating information relating to a relative gain between the coded media data and the additional uncompressed PCM audio data and embedding the information relating to the relative gain in the bitstream.

### Claim 5

(canceled)

### Claim 6

(canceled)

### Claim 7 (depends on 2)

Method according to claim 2, wherein further the generated information and/or the generated information relating to the relative gain are embedded in the bitstream by transporting the generated information and/or the generated information relating to the relative gain in the modified bitstream via the MPEG-4 audio bitstream extension mechanism.

### Claim 8

(canceled)

### Claim 9 (depends on 1)

Method according to claim 1, wherein the MPEG-4 audio bitstream extension mechanism is a data stream element (DSE) and the data stream element (DSE) is located at a predefined position in the modified bitstream and/or includes a specific instance tag.

### Claim at position 10

10-15. (canceled)

### Claim 16 (depends on 1)

Method according to claim 1, wherein in step c) the modified bitstream is output to the sink device via a Bluetooth connection.

### Claim at position 12

17-18. (canceled)

### Claim 19 (depends on 1)

Method according to claim 1, wherein the generation of the PCM audio data is based on a user input.

### Claim 20 (depends on 1)

Method according to claim 1, wherein the PCM audio data include one or more of earcon-data and system sounds data.

### Claim 21

(canceled)

### Claim 22

A method for processing a modified bitstream in MPEG-4 audio format by a sink device comprising a receiver, a bitstream parser, a core decoder, a mixer, wherein the method includes the steps of:
a) receiving, by the receiver, a modified bitstream including coded media data, payload of additional uncompressed PCM audio data and an MPEG-4 audio bitstream extension mechanism, wherein the MPEG-4 audio bitstream extension mechanism is a data stream element (DSE);
b) parsing, by the bitstream parser, the modified bitstream into the coded media data and the payload of additional uncompressed PCM audio data, wherein the parsing is based on identifying the MPEG-4 audio bitstream extension mechanism in the modified bitstream;
c) core decoding, by the core decoder, the coded media data to obtain core decoded media data;
d) mixing, by the mixer, the core decoded media data and the additional uncompressed PCM audio data to obtain an output signal; and
e) outputting the output signal.

### Claim 23 (depends on 22)

Method according to claim 22, wherein the modified bitstream further includes information on the additional uncompressed PCM audio data, and wherein the method further includes, after step a) and before step b), a step of processing the modified bitstream based on the information.

### Claim 24 (depends on 23)

Method according to claim 23, wherein the information includes one or more of information on a configuration of the additional uncompressed PCM audio data, information on a presence of the additional uncompressed PCM audio data in the modified bitstream, information on a default loudness value, information on a value for delay alignment, information on delay adaption, information on panning and information on a type of the additional uncompressed PCM audio data.

### Claim 25 (depends on 22)

Method according to claim 22, wherein the modified bitstream further includes information relating to a relative gain between the coded media data and the additional uncompressed PCM audio data, and wherein mixing in step d) the core decoded media data and the additional uncompressed PCM audio data is based on the information relating to the relative gain.

### Claim 26 (depends on 10)

Method according to claim 10, wherein the method further includes the step of processing, by a processing unit, the additional uncompressed PCM audio data prior to mixing the core decoded media data and the additional uncompressed PCM audio data.

### Claim 27 (depends on 26)

Method according to claim 26, wherein processing the additional uncompressed PCM audio data includes one or more of resampling, delay adaption and loudness processing.

### Claim at position 22

28-32. (canceled)

### Claim 33 (depends on 22)

Method according to claim 22, wherein parsing in step b) is further based on identifying a position of the data stream element in the modified bitstream and/or identifying a specific instance tag of the data stream element.

### Claim 34

(canceled)

### Claim 35

Source device for generating a modified bitstream in MPEG-4 audio format, wherein the device includes:
a) a receiver configured to receive a bitstream including coded media data;
b) an embedder configured to generate payload of additional uncompressed PCM audio data and to embed the generated payload in the bitstream to obtain a modified bitstream including the coded media data and the payload of the additional uncompressed PCM audio data wherein the embedder is further configured to embed the generated payload in the bitstream by transporting the payload in the modified bitstream via an MPEG-4 audio bitstream extension mechanism, wherein the MPEG-4 audio bitstream extension mechanism is a data stream element (DSE); and
c) a control unit configured to output the modified bitstream to a sink device.

### Claim at position 26

36-43. (canceled)

### Claim 44

Sink device for processing a modified bitstream in MPEG-4 audio format, wherein the device includes:
a) a receiver configured to receive a modified bitstream including coded media data, payload of additional uncompressed PCM audio data and an MPEG-4 audio bitstream extension mechanism, wherein the MPEG-4 audio bitstream extension mechanism is a data stream element (DSE);
b) a bitstream parser configured to parse the modified bitstream into the coded media data and the payload of the additional uncompressed PCM audio data, wherein the bitstream parser is further configured to parse the modified bitstream based on identifying the MPEG-4 audio bitstream extension mechanism in the modified bitstream;
c) a core decoder configured to core decode the coded media data to obtain core decoded media data;
d) a mixer configured to mix the core decoded media data and the additional uncompressed PCM audio data to obtain an output signal; and
e) a control unit configured to output the output signal.

### Claim 45 (depends on 44)

Device according to claim 44, wherein the device further includes a processing unit configured to process the additional uncompressed PCM audio data prior to mixing the core decoded media data and the additional uncompressed PCM audio data.

### Claim at position 29

46-47. (canceled)

### Claim 48 (depends on 48)

Device according to claim 48, wherein the modified bitstream further includes information on the additional uncompressed PCM audio data, and wherein the sink device is configured to process the modified bitstream based on the information.

### Claim 49 (depends on 48)

Device according to claim 48, wherein the modified bitstream further includes information relating to a relative gain between the coded media data and the additional uncompressed PCM audio data, and wherein the mixer is further configured to mix the core decoded media data and the additional uncompressed PCM audio data based on the information relating to the relative gain.

### Claim 50 (depends on 48)

Device according to claim 48, wherein the core decoder is an MPEG-4 audio decoder.

### Claim at position 33

51-52. (canceled)
