# US 2018/0322888 A1 · Transmitting apparatus, transmitting method, receiving apparatus, and receiving method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0322888 A1 - Document ID: US20180322888A1 - Status: Published application - Kind: A1 - Application number: 15/775,154 - Filed: 2016-12-06 - Published: 2018-11-08 - Earliest claimed: 2015-12-08 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Ikuo TSUKAGOSHI - Web page: https://patentgrep.com/patent/US20180322888A1 ## CPC - G10L 19/167: {Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes} - G10L 15/00: Speech recognition (G10L17/00 takes precedence) - G10L 19/00: Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis (in musical instruments G10H) - G10L 19/018: Audio watermarking, i.e. embedding inaudible data in the audio signal - G10L 21/00: Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility (G10L19/00 takes precedence) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract A process of an audio stream on a receiving side is facilitated. Encoding processing is performed on audio data and an audio stream in which an audio frame including audio compression data is continuously arranged is generated. Tag information indicating that the audio compression data of a predetermined sound unit is included is inserted into the audio frame including the audio compression data of the predetermined sound unit. A container stream of a predetermined format including the audio stream into which the tag information is inserted is transmitted. ## Claims ### Claim 1 A transmitting apparatus comprising: a stream generating section configured to generate an audio stream in which an audio frame including audio compression data obtained by performing encoding processing on audio data is continuously arranged; an information inserting section configured to insert tag information indicating that the audio compression data of a predetermined sound unit is included into the audio frame including the audio compression data of the predetermined sound unit; and a transmitting section configured to transmit a container stream of a predetermined format including the audio stream into which the tag information is inserted. ### Claim 2 (depends on 1) The transmitting apparatus according to claim 1, wherein the tag information has type information indicating that a start position of the audio compression data of the predetermined sound unit is included, an end position thereof is included, or neither of the start position and the end position is included. ### Claim 3 (depends on 2) The transmitting apparatus according to claim 2, wherein the tag information has offset information indicating an offset of a sample unit from a frame head to the start position when the type information indicates that the start position is included and indicating an offset of a sample unit from a frame head to the end position when the type information indicates that the end position is included. ### Claim 4 (depends on 1) The transmitting apparatus according to claim 1, wherein the tag information has frame count information indicating a frame position from a service head of the audio frame into which the tag information is inserted. ### Claim 5 (depends on 1) The transmitting apparatus according to claim 1, wherein when the predetermined sound unit is provided in plurality, the tag information has sound unit identification information for identifying a corresponding sound unit. ### Claim 6 (depends on 1) The transmitting apparatus according to claim 1, wherein when the predetermined sound unit is provided in plurality and sound units of a plurality of generation sources are included in the plurality of sound units, the tag information has generation source identification information for identifying the generation source of the corresponding sound unit. ### Claim 7 (depends on 1) The transmitting apparatus according to claim 1, wherein the stream generating section performs encoding processing on the audio data of a plurality of groups and generates the audio stream in which the audio frame including the audio compression data of the plurality of groups is continuously arranged, and the tag information has group identification information for identifying a group to which the audio compression data of the predetermined sound unit belongs. ### Claim 8 (depends on 7) The transmitting apparatus according to claim 7, wherein when a group indicated by the group identification information is a group constituting a predetermined switch group, the tag information has switch group identification information for identifying the predetermined switch group. ### Claim 9 (depends on 1) The transmitting apparatus according to claim 1, wherein the information inserting section further inserts table information having information associated with the predetermined sound unit within the audio stream into a layer of the container stream and/or a layer of the audio stream. ### Claim 10 (depends on 9) The transmitting apparatus according to claim 9, wherein when the predetermined sound unit is provided in plurality, information associated with the plurality of sound units has sound unit identification information for identifying the corresponding sound unit, individually. ### Claim 11 (depends on 9) The transmitting apparatus according to claim 9, wherein when the predetermined sound unit is provided in plurality and the sound units of a plurality of generation sources are included in the plurality of sound units, information associated with the plurality of sound units has generation source identification information for identifying a generation source of the corresponding sound unit, individually. ### Claim 12 (depends on 9) The transmitting apparatus according to claim 9, wherein information associated with the predetermined sound unit has frame count information indicating a frame position from a service head of the audio frame including the audio compression data of the predetermined sound unit. ### Claim 13 A transmitting method comprising: generating an audio stream in which an audio frame including audio compression data obtained by performing encoding processing on audio data is continuously arranged; inserting tag information indicating that the audio compression data of a predetermined sound unit is included into the audio frame including the audio compression data of the predetermined sound unit; and transmitting, by a transmitting section, a container stream of a predetermined format including the audio stream into which the tag information is inserted. ### Claim 14 A receiving apparatus comprising: a receiving section configured to receive a container stream of a predetermined format including an audio stream in which an audio frame including audio compression data is continuously arranged, wherein the audio frame including the audio compression data of a predetermined sound unit includes tag information indicating that the audio compression data of the predetermined sound unit is included, the receiving apparatus, further comprising a processing section configured to perform a process of the audio stream by using the tag information. ### Claim 15 (depends on 14) The receiving apparatus according to claim 14, wherein the processing section includes a decoding section configured to perform decoding processing on the audio compression data included in each audio frame of the audio stream and obtain audio data, and a data segmenting and holding section configured to segment the audio data corresponding to the predetermined sound unit from the audio data obtained by the decoding section and hold the audio data in a buffer on the basis of the tag information. ### Claim 16 (depends on 15) The receiving apparatus according to claim 15, wherein the processing section further includes a data output section configured to read and output the audio data corresponding to the predetermined sound unit from the buffer on the basis of operational information of a user. ### Claim 17 (depends on 14) The receiving apparatus according to claim 14, wherein the processing section further includes a decoding section configured to perform decoding processing on the audio compression data included in each audio frame of the audio stream and obtain the audio data, and a caption data generating section configured to segment the audio data corresponding to the predetermined sound unit from the audio data obtained by the decoding section, perform a text conversion, and generate caption data on the basis of the tag information. ### Claim 18 A receiving method comprising: receiving, by a receiving section, a container stream of a predetermined format including an audio stream in which an audio frame including audio compression data is continuously arranged, wherein the audio frame including the audio compression data of a predetermined sound unit includes tag information indicating that the audio compression data of the predetermined sound unit is included, the receiving method, further including performing a process of the audio stream by using the tag information. ### Claim 19 (canceled) ### Claim 20 (canceled)