# US 12,770,632 B2 · Transmission apparatus, transmission method. reception apparatus and reception method for transmitting a plurality of types of audio data items

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,770,632 B2
- Document ID: US12770632B2
- Status: Granted
- Kind: B2
- Application number: 18/526,596
- Filed: 2023-12-01
- Published: 2024-04-04
- Granted: 2026-10-20
- Earliest claimed: 2014-09-30
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Ikuo Tsukagoshi
- Web page: https://patentgrep.com/patent/US12770632B2

## CPC

- G10L 19/167: {Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes}
- G10L 19/00: Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis (in musical instruments G10H)
- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- H04L 65/65: Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
- H04L 65/75: Media network packet handling
- H04L 65/80: Responding to QoS
- H04N 21/44209: {Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network (arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896)}
- H04N 21/6375: for requesting retransmission {, e.g. of data packets lost or corrupted during transmission from server}(ARQ protocols H04L1/18; implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP] H04L69/16)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

To reduce a processing load at a reception side in a case where a plurality kinds of audio data items are transmitted. A container in a predetermined format having a predetermined number of audio streams including coded data items of a plurality of groups is transmitted. For example, the coded data items of the plurality of groups include either or both of channel coded data items and object coded data items. Attribute information indicating respective attributes of the coded data items of the plurality of groups is inserted into a layer of the container and/or a layer of an audio stream. For example, stream correspondence relation information indicating which audio stream includes each of the coded data items of the plurality of groups is further inserted.

## Claims

### Claim 1

An information processing device comprising:
reception circuitry configured to receive a container in a predetermined format;
a demultiplexer that extracts a plurality of audio streams included in the container in a predetermined format;
a combiner that outputs a synthesized audio stream obtained by synthesizing the plurality of audio streams; and
a decoder that performs decoding processing for obtaining audio data for driving one or more audio output devices with respect to the synthesized audio stream,
wherein the synthesized audio stream includes coded data, the coded data including object coded data, the object coded data including an audio object and metadata for mapping and rendering the audio object on the one or more audio output devices,
wherein the coded data is classified into groups by type,
wherein the plurality of audio streams includes an identifier indicating a content type, the identifier having a value from 0 to 15,
wherein the plurality of audio streams includes a group identifier (group ID) that is an identifier for identifying a group, a switch group identifier (switch Group ID) that is an identifier for identifying a switching group, and a preset group identifier (preset Group ID) that is an identifier for identifying a preset group,
wherein the plurality of audio streams comprises an audio frame, the audio frame including a plurality of audio stream packets, each audio stream packet including a header and a payload,
wherein the header comprises a packet type information, a packet label, and a packet length,
wherein the payload of a first audio stream packet of the plurality of audio stream packets includes a SYNC information corresponding to a synchronization start code,
wherein the payload of a second audio stream packet of the plurality of audio stream packets includes a Frame information comprising the coded data,
wherein the payload of a third audio stream packet of the plurality of audio stream packets includes a Config information indicating a configuration of the Frame information, and
wherein the metadata is included as an extension element configured to map and render a single channel element to a speaker.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein the container in a predetermined format is MPEG-2 TS (Moving Picture Experts Group-2 Transport Stream).

### Claim 3 (depends on 1)

The information processing device according to claim 1, wherein the synthesized audio stream includes channel coded data.

### Claim 4 (depends on 1)

The information processing device according to claim 1, wherein the plurality of audio streams includes a main stream and a sub stream.

### Claim 5 (depends on 1)

The information processing device according to claim 1, wherein the coded data selectable between the groups is registered in the switch group and coded.

### Claim 6 (depends on 4)

The information processing device according to claim 4, wherein the plurality of audio streams includes an identifier for identifying the sub stream.

### Claim 7 (depends on 3)

The information processing device according to claim 3, wherein the object coded data includes coded data for a spoken language.

### Claim 8 (depends on 1)

The information processing device according to claim 1, wherein the plurality of audio streams includes a descriptor describing information related to each of the audio streams.

### Claim 9 (depends on 8)

The information processing device according to claim 8, wherein the descriptor has a descriptor tag field of an 8-bit field which is information indicating a descriptor type of the descriptor.

### Claim 10 (depends on 8)

The information processing device according to claim 8, wherein the descriptor has a descriptor length field of an 8-bit field which is information indicating a length or a size of the descriptor.

### Claim 11 (depends on 1)

The information processing device according to claim 1, wherein an audio elementary stream loop (audio ES loop) corresponding to each of the plurality of audio streams includes a descriptor describing information related to each of the audio streams.

### Claim 12

An information processing method comprising:
receiving a container in a predetermined format;
extracting a plurality of audio streams included in the container in a predetermined format;
outputting a synthesized audio stream obtained by synthesizing the plurality of audio streams; and
performing decoding processing for obtaining audio data for driving one or a plurality of output units with respect to the synthesized audio stream,
wherein the synthesized audio stream includes coded data, the coded data including object coded data, the object coded data including an audio object and metadata for mapping and rendering the audio object on one or more audio output devices,
wherein the coded data is classified into groups by type,
wherein the plurality of audio streams includes an identifier indicating a content type, the identifier having a value from 0 to 15,
wherein the plurality of audio streams includes a group identifier (group ID) that is an identifier for identifying a group, a switch group identifier (switch Group ID) that is an identifier for identifying a switching group, and a preset group identifier (preset Group ID) that is an identifier for identifying a preset group,
wherein the plurality of audio streams comprises an audio frame, the audio frame including a plurality of audio stream packets, each audio stream packet including a header and a payload,
wherein the header comprises a packet type information, a packet label, and a packet length,
wherein the payload of a first audio stream packet of the plurality of audio stream packets includes a SYNC information corresponding to a synchronization start code,
wherein the payload of a second audio stream packet of the plurality of audio stream packets includes a Frame information comprising the coded data,
wherein the payload of a third audio stream packet of the plurality of audio stream packets includes a Config information indicating a configuration of the Frame information, and
wherein the metadata is included as an extension element configured to map and render a single channel element to a speaker.

### Claim 13

A non-transitory computer readable medium having stored thereon a program for causing a computer to execute an information processing method, the information processing method comprising:
receiving a container in a predetermined format;
extracting a plurality of audio streams included in the container in a predetermined format;
outputting a synthesized audio stream obtained by synthesizing the plurality of audio streams; and
performing decoding processing for obtaining audio data for driving one or a plurality of output units with respect to the synthesized audio stream,
wherein the synthesized audio stream includes coded data, the coded data including object coded data, the object coded data including an audio object and metadata for mapping and rendering the audio object on one or more audio output devices,
wherein the coded data is classified into groups by type,
wherein the plurality of audio streams includes an identifier indicating a content type, the identifier having a value from 0 to 15,
wherein the plurality of audio streams includes a group identifier (group ID) that is an identifier for identifying a group, a switch group identifier (switch Group ID) that is an identifier for identifying a switching group, and a preset group identifier (preset Group ID) that is an identifier for identifying a preset group,
wherein the plurality of audio streams comprises an audio frame, the audio frame including a plurality of audio stream packets, each audio stream packet including a header and a payload,
wherein the header comprises a packet type information, a packet label, and a packet length,
wherein the payload of a first audio stream packet of the plurality of audio stream packets includes a SYNC information corresponding to a synchronization start code,
wherein the payload of a second audio stream packet of the plurality of audio stream packets includes a Frame information comprising the coded data,
wherein the payload of a third audio stream packet of the plurality of audio stream packets includes a Config information indicating a configuration of the Frame information, and
wherein the metadata is included as an extension element configured to map and render a single channel element to a speaker.