# US 2010/0061466 A1 · Digital broadcast transmitting apparatus, digital broadcast receiving apparatus, and digital broadcast transmitting/receiving system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0061466 A1
- Document ID: US20100061466A1
- Status: Published application
- Kind: A1
- Application number: 12/531,962
- Filed: 2008-03-19
- Published: 2010-03-11
- Earliest claimed: 2007-03-26
- Inventors: Shinya Gozen; Yoshiaki Takagi; Kaoru Iwakuni; Takashi Katayama
- Web page: https://patentgrep.com/patent/US20100061466A1

## CPC

- H04H 20/95: characterised by a specific format, e.g. an encoded audio stream
- G10L 19/167: {Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes}
- H04H 20/42: Arrangements for resource management
- H04H 20/65: Arrangements characterised by transmission systems for broadcast
- H04N 19/156: Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
- H04N 19/61: in combination with predictive coding
- H04N 21/2335: {involving reformatting operations of audio signals, e.g. by converting from one coding standard to another (details of audio signal transcoding G10L19/173)}
- H04N 21/23614: {Multiplexing of additional data and video streams (arrangements for simultaneous broadcast of plural pieces of information H04H20/28)}
- H04N 21/2368: Multiplexing of audio and video streams
- H04N 21/43072: {of multiple content streams on the same device}
- H04N 21/4341: {Demultiplexing of audio and video streams}
- H04N 21/4348: {Demultiplexing of additional data and video streams}
- H04N 21/439: Processing of audio elementary streams
- H04N 21/6332: directed to client
- H04N 21/654: Transmission by server directed to the client
- H04N 21/6547: comprising parameters, e.g. for client setup
- H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

For MPEG-2 AAC, MPEG-Surround or (AAC+SBR), whether a received bitstream is of AAC or MPS can not be determined till the details of the received bitstream is analyzed up to the end. Therefore, if the output delay of an audio signal is large, the output of a video signal cannot appropriately be delayed under control, not allowing A/V synchronization. A transmitting apparatus includes: a data packet generating unit which generates a data packet including encoding information that is not included in the header information of an audio stream packet and that indicates whether any processing is included which causes the decoding time of the encoded audio signal to exceed a predetermined decoding time, the data packet being analyzed by a receiving apparatus before decoding the audio stream packet is started; and a transmitting unit which transmits the audio stream packet, data packet and video stream packet via multiplex broadcast. The receiving apparatus can know the information specific to the encoding scheme without analyzing the details of the encoded signal up to the end.

## Claims

### Claim 1

A digital broadcast transmitting apparatus which provides multiplex broadcast by encoding and packetizing an audio signal and a video signal that are reproduced in synchronization, said digital broadcast transmitting apparatus comprising:
an audio stream packet generating unit configured to convert the audio signal into an encoded audio signal by encoding the audio signal and to generate an audio stream packet including the encoded audio signal;
a data packet generating unit configured to generate a data packet which is analyzed by a digital broadcast receiving apparatus before decoding the audio stream packet is started, the data packet including encoding information which is not included in header information of the audio stream packet, and which indicates whether or not decoding of the encoded audio signal includes a processing which causes decoding time of the encoded audio signal to exceed a predetermined decoding time;
a video stream packet generating unit configured to convert the video signal into an encoded video signal by encoding the video signal, and to generate a video stream packet including the encoded video signal; and
a transmitting unit configured to multiplex the audio stream packet, the data packet, and the video stream packet so as to generate multiplexed data, and transmit the generated multiplexed data via a broadcast wave.

### Claim 2 (depends on 1)

The digital broadcast transmitting apparatus according to Claim 1,
wherein said audio stream packet generating unit includes an audio encoding unit configured to convert the audio signal into the encoded audio signal using one of a first encoding mode and a second encoding mode, the first encoding mode being a mode in which the audio signal is encoded in accordance with MPEG-2 AAC scheme, the second encoding mode being a mode in which the audio signal is encoded in accordance with the MPEG-2 AAC scheme, and is also encoded including auxiliary information for extending a high frequency component or an output channel count of a basic signal obtained in the first encoding mode, and
said data packet generating unit includes an encoding information generating unit configured to generate the encoding information indicating which one of the first encoding mode and the second encoding mode has been used by said audio encoding unit in the conversion of the audio signal into the encoded audio signal.

### Claim 3 (depends on 2)

The digital broadcast transmitting apparatus according to Claim 2,
wherein said data packet generating unit is configured to generate an independent data packet including only the encoding information as data.

### Claim 4 (depends on 3)

The digital broadcast transmitting apparatus according to Claim 3,
wherein said data packet generating unit is configured to generate the data packet for each audio stream packet generated by said audio stream packet generating unit, and
when data packet includes information that is identical to information included in an immediately preceding data packet, said transmitting unit is configured to transmit multiplexed data in which the data packet is not multiplexed.

### Claim 5 (depends on 2)

The digital broadcast transmitting apparatus according to Claim 2,
wherein said data packet generating unit is configured to generate the data packet in a format defined as a section format.

### Claim 6 (depends on 2)

The digital broadcast transmitting apparatus according to Claim 2,
wherein said data packet generating unit is configured: (i) to represent, using a descriptor, the encoding information indicating which one of the first encoding mode and the second encoding mode has been used by said audio encoding unit in the conversion of the audio signal into the encoded audio signal; and (ii) to generate a packet in which the descriptor is embedded into a descriptor area, the descriptor area being repeated for each of elementary streams within a program map table (PMT).

### Claim 7 (depends on 2)

The digital broadcast transmitting apparatus according to Claim 2,
wherein, said data packet generating unit is configured to further generate a data packet including encoding information indicating an extended channel count of the basic signal, the extended channel count of the basic signal being an output channel count of the basic signal of the case where the output channel count of the basic signal is extended using the auxiliary information.

### Claim 8 (depends on 2)

The digital broadcast transmitting apparatus according to Claim 2,
wherein said data packet generating unit is configured to further generate a data packet including encoding information indicating data length of the basic signal.

### Claim 9

A digital broadcast receiving apparatus which receives multiplex broadcast in which an audio signal and a video signal are encoded, packetized, and transmitted, the audio signal and the video signal being reproduced in synchronization, said digital broadcast receiving apparatus comprising:
a receiving unit configured to receive the multiplex broadcast;
a separating unit configured to separate, from multiplexed data, an audio stream packet, a video stream packet, and a data packet, the multiplexed data being received by said receiving unit via the multiplex broadcast, the audio stream packet including an encoded audio signal which is an audio signal that has been encoded, the video stream packet including an encoded video signal which is a video signal that has been encoded, the data packet being other than the audio stream packet and the video stream packet;
an analyzing unit configured to analyze encoding information from the separated data packet before decoding the audio stream packet is started, the encoding information being information which is not included in header information of the audio stream packet, and which indicates whether or not decoding of the encoded audio signal includes a processing which causes decoding time of the encoded audio signal to exceed a predetermined decoding time; and
a decoding unit configured to adjust output timings of the audio signal and the video signal by an amount of time that the decoding time of the audio signal exceeds the predetermined decoding time, when the encoding information indicates the decoding of the encoded audio signal includes the processing which causes the decoding time of the encoded audio signal to exceed the predetermined decoding time.

### Claim 10 (depends on 9)

The digital broadcast receiving apparatus according to claim 9,
wherein said separating unit is configured to separate, from the received multiplexed data, the audio stream packet including the encoded audio signal which has been encoded using one of a first encoding mode and a second encoding mode, the first encoding mode being a mode in which the audio signal is encoded in accordance with MPEG-2 AAC scheme, the second encoding mode being a mode in which the audio signal is encoded in accordance with the MPEG-2 AAC scheme, and is also encoded including auxiliary information for extending a high frequency component or an output channel count of a basic signal obtained in the first encoding mode;
said analyzing unit is configured to analyze, based on the encoding information, which one of the first encoding mode and the second encoding mode has been used in the encoding of the encoded audio signal included in the separated audio stream packet; and
said decoding unit is configured to adjust output timings of the audio signal and the video signal by an amount of time necessary for extending the high frequency component or the output channel count of the basic signal obtained in the first encoding mode, when the analysis result obtained by said analyzing unit indicates that the second encoding mode has been used in the encoding.

### Claim 11 (depends on 10)

The digital broadcast receiving apparatus according to claim 10,
wherein, when the analysis result obtained by said analyzing unit indicates that the second encoding mode has been used in the encoding of the encoded audio signal included in the separated audio stream packet, said decoding unit is configured to delay outputting the video signal by a predetermined time than the case where the first encoding mode has been used in the encoding.

### Claim 12 (depends on 10)

The digital broadcast receiving apparatus according to claim 10,
wherein, when the analysis result obtained by said analyzing unit indicates that the second encoding mode has been used in the encoding of the encoded audio signal included in the separated audio stream packet, said decoding unit is configured to start decoding of the encoded audio signal earlier by a predetermined time than the case where the first encoding mode has been used in the encoding.

### Claim 13 (depends on 10)

The digital broadcast receiving apparatus according to claim 10,
wherein the predetermined time is a delay time that is an additional time required for decoding processing of the encoded audio signal in the second mode compared to decoding processing of the encoded audio signal in the first mode.

### Claim 14 (depends on 10)

The digital broadcast receiving apparatus according to claim 10,
wherein said analyzing unit is configured to further analyze, based on the encoding information, an extended channel count of the basic signal, the extended channel count of the basic signal being an output channel count of the basic signal of the case where the output channel count of the basic signal is extended using the auxiliary information, and
when the output channel count of said digital broadcast receiving apparatus is different from the channel count indicated by the encoding information, said decoding unit is configured: (i) to extend the channel count of the basic signal directly into the output channel count of said digital broadcast receiving apparatus; and (ii) to adjust output timings of the audio signal and the video signal by an amount of time necessary for extending the output channel count of the basic signal.

### Claim 15 (depends on 14)

The digital broadcast receiving apparatus according to claim 14,
wherein said decoding unit includes:
a multi-channel estimating unit configured to estimate channel extension information, using one of channel-extension related information included in the basic signal, and an initial value or a recommended value used for channel count extension from 2-channel of the basic signal into 5.1-channel of a multi-channel signal, the channel extension information being information for extending the channel count of the basic signal to the output channel count of said digital broadcast receiving apparatus, and
said decoding unit is configured to extend the channel count of the basic signal directly into the output channel count of said digital broadcast receiving apparatus, using the channel extension information estimated by said multi-channel estimating unit.

### Claim 16 (depends on 15)

The digital broadcast receiving apparatus according to claim 15,
wherein said analyzing unit is configured to further analyze, based on the encoding information, data length of the basic signal of the encoded audio signal, and
said decoding unit is configured: (i) to determine whether or not the basic signal has been correctly decoded by comparing the data length of the basic signal obtained by said analyzing unit and data length of the basic signal obtained though decoding of the encoded audio signal; and (ii) to extend, using the channel extension information estimated by said multi-channel estimating unit, the channel count of the basic signal directly into the output channel count of said digital broadcast receiving apparatus, when determined that the basic signal has been correctly decoded.

### Claim 17 (depends on 16)

The digital broadcast receiving apparatus according to claim 16,
wherein said decoding unit is configured: (i) to further determine whether or not the channel extension processing using the auxiliary information has been correctly performed, when determined that the basic signal has been correctly decoded; and (ii) to output only the basic signal without adjusting output timings of the audio signal and the video signal, when determined that an error has occurred in the channel extension processing using the auxiliary information.

### Claim 18

A digital broadcast transmitting-receiving system comprising a digital broadcast transmitting apparatus and a digital broadcast receiving apparatus, said digital broadcast transmitting apparatus providing multiplex broadcast by encoding, and packetizing an audio signal and a video signal that are reproduced in synchronization, said digital broadcast receiving apparatus receiving the multiplex broadcast,
wherein said digital broadcast transmitting apparatus includes:
an audio stream packet generating unit configured to convert the audio signal into an encoded audio signal by encoding the audio signal, and to generate an audio stream packet including the encoded audio signal;
a data packet generating unit configured to generate a data packet which is analyzed by a digital broadcast receiving apparatus before decoding the audio stream packet is started, the data packet including encoding information which is not included in header information of the audio stream packet, and which indicates whether or not decoding of the encoded audio signal includes a processing which causes decoding time of the encoded audio signal to exceed a predetermined decoding time;
a video stream packet generating unit configured to convert the video signal into an encoded video signal by encoding the video signal, and to generate a video stream packet including the encoded video signal; and
a transmitting unit configured to multiplex the audio stream packet, the data packet, and the video stream packet so as to generate multiplexed data, and transmit the generated multiplexed data via a broadcast wave, and
said digital broadcast receiving apparatus includes:
a receiving unit configured to receive the multiplex broadcast;
a separating unit configured to separate, from the multiplexed data, the audio stream packet, the video stream packet, and the data packet, the multiplexed data being received by said receiving unit via the multiplex broadcast, the audio stream packet including the encoded audio signal which is an audio signal that has been encoded, the video stream packet including the encoded video signal which is a video signal that has been encoded, the data packet being other than the audio stream packet and the video stream packet;
an analyzing unit configured to analyze the encoding information from the separated data packet before decoding of the audio stream packet is started, the encoding information being information which is not included in the header information of the audio stream packet, and which indicates whether or not decoding of the encoded audio signal includes the processing which causes decoding time of the encoded audio signal to exceed the predetermined decoding time; and
a decoding unit configured to adjust output timings of the audio signal and the video signal by an amount of time that the decoding time of the audio signal exceeds the predetermined decoding time, when the encoding information indicates the decoding of the encoded audio signal includes the processing which causes the decoding time of the encoded audio signal to exceed the predetermined decoding time.

### Claim 19

A digital broadcast transmitting method in which an audio signal and a video signal are encoded and packetized for multiplex broadcast being provided, the audio signal and video signal being reproduced in synchronization, said digital broadcast transmitting method comprising:
converting the audio signal into an encoded audio signal by encoding the audio signal, and generating an audio stream packet including the encoded audio signal, said encoding and generating being performed by an audio stream packet generating unit;
generating a data packet which is analyzed by a digital broadcast receiving apparatus before decoding the audio stream packet is started, the data packet including encoding information which is not included in header information of the audio stream packet, and which indicates whether or not decoding of the encoded audio signal includes a processing which causes decoding time of the encoded audio signal to exceed a predetermined decoding time, said generating being performed by a data packet generating unit;
converting the video signal into an encoded video signal by encoding the video signal, and generating a video stream packet including the encoded video signal, said encoding and generating being performed by a video stream packet generating unit; and
multiplexing the audio stream packet, the data packet, and the video stream packet so as to generate multiplexed data, and transmitting the generated multiplexed data via a broadcast wave, said multiplexing and transmitting being performed by a transmitting unit.

### Claim 20

A digital broadcast receiving method in which multiplex broadcast is received where an audio signal and a video signal are encoded, packetized and transmitted, the audio signal and the video signal being reproduced in synchronization, said digital broadcast receiving method comprising:
receiving the multiplex broadcast, said receiving being performed by a receiving unit;
separating, from multiplexed data, an audio stream packet, a video stream packet, and a data packet, the multiplexed data being received by said receiving unit via the multiplex broadcast, the audio stream packet including an encoded audio signal which is an audio signal that has been encoded, the video stream packet including an encoded video signal which is a video signal that has been encoded, the data packet being other than the audio stream packet and the video stream packet, said separating being performed by a separating unit;
analyzing encoding information from the separated data packet before decoding the audio stream packet is started, the encoding information being information which is not included in header information of the audio stream packet, and which indicates whether or not decoding of the encoded audio signal includes a processing which causes decoding time of the encoded audio signal to exceed a predetermined decoding time, said analyzing being performed by an analyzing unit; and
adjusting output timings of the audio signal and the video signal by an amount of time that the decoding time of the audio signal exceeds the predetermined decoding time, when the encoding information indicates the decoding of the encoded audio signal includes the processing which causes the decoding time of the encoded audio signal to exceed the predetermined decoding time, said adjusting being performed by a decoding unit.

### Claim 21

A program for a digital broadcast transmitting apparatus which provides multiplex broadcast by encoding and packetizing an audio signal and a video signal that are reproduced in synchronization, said program causing a computer to execute:
converting the audio signal into an encoded audio signal by encoding the audio signal, and generating an audio stream packet including the encoded audio signal;
generating a data packet which is analyzed by a digital broadcast receiving apparatus before decoding the audio stream packet is started, the data packet including encoding information which is not included in header information of the audio stream packet, and which indicates whether or not decoding of the encoded audio signal includes a processing which causes decoding time of the encoded audio signal to exceed a predetermined decoding time;
converting the video signal into an encoded video signal by encoding the video signal, and generating a video stream packet including the encoded video signal; and
multiplexing the audio stream packet, the data packet, and the video stream packet so as to generate multiplexed data, and transmitting the generated multiplexed data via a broadcast wave.

### Claim 22

A program for a digital broadcast receiving apparatus which receives multiplex broadcast in which an audio signal and a video signal are encoded, packetized, and transmitted, the audio signal and the video signal being reproduced in synchronization, said program causing a computer to execute:
receiving the multiplex broadcast;
separating, from multiplexed data, an audio stream packet, a video stream packet, and a data packet, the multiplexed data being received by said receiving unit via the multiplex broadcast, the audio stream packet including an encoded audio signal which is an audio signal that has been encoded, the video stream packet including an encoded video signal which is a video signal that has been encoded, the data packet being other than the audio stream packet and the video stream packet;
analyzing encoding information from the separated data packet before decoding the audio stream packet is started, the encoding information being information which is not included in header information of the audio stream packet, and which indicates whether or not decoding of the encoded audio signal includes a processing which causes decoding time of the encoded audio signal to exceed a predetermined decoding time; and
adjusting output timings of the audio signal and the video signal by an amount of time that the decoding time of the audio signal exceeds the predetermined decoding time, when the encoding information indicates the decoding of the encoded audio signal includes the processing which causes the decoding time of the encoded audio signal to exceed the predetermined decoding time.

### Claim 23

A semiconductor integrated circuit which receives multiplex broadcast in which an audio signal and a video signal are encoded, packetized, and transmitted, the audio signal and the video signal being reproduced in synchronization, said semiconductor integrated circuit comprising:
a receiving unit configured to receive the multiplex broadcast;
a separating unit configured to separate, from multiplexed data, an audio stream packet, a video stream packet, and a data packet, the multiplexed data being received by said receiving unit via the multiplex broadcast, the audio stream packet including an encoded audio signal which is an audio signal that has been encoded, the video stream packet including an encoded video signal which is a video signal that has been encoded, the data packet being other than the audio stream packet and the video stream packet;
an analyzing unit configured to analyze encoding information from the separated data packet before decoding the audio stream packet is started, the encoding information being information which is not included in header information of the audio stream packet, and which indicates whether or not decoding of the encoded audio signal includes a processing which causes decoding time of the encoded audio signal to exceed a predetermined decoding time; and
a decoding unit configured to adjust output timings of the audio signal and the video signal by an amount of time that the decoding time of the audio signal exceeds the predetermined decoding time, when the encoding information indicates the decoding of the encoded audio signal includes the processing which causes the decoding time of the encoded audio signal to exceed the predetermined decoding time.
