# US 2010/0063828 A1 · Stream synthesizing device, decoding unit and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0063828 A1
- Document ID: US20100063828A1
- Status: Published application
- Kind: A1
- Application number: 12/519,248
- Filed: 2008-10-16
- Published: 2010-03-11
- Earliest claimed: 2007-10-16
- Assignees: Panasonic Corporation
- Inventors: Tomokazu Ishikawa; Takeshi Norimatsu; Takashi Katayama
- Web page: https://patentgrep.com/patent/US20100063828A1

## CPC

- H04M 3/568: {audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants (echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30)}
- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- H04L 65/70: Media network packetisation
- G10L 25/12: the extracted parameters being prediction coefficients
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

To provide an enhanced true-to-life atmosphere enjoyed in multipoint connecting, and reduce a calculation load at a multipoint connection unit, as well. A stream synthesizing device includes an input unit which inputs at least two coded signals each including a first downmix acoustic signal and an extended signal, each of first downmix acoustic signals being obtained by coding an acoustic signal into which at least two sound signals are downmixed, and the extended signal being for obtaining the at least two sound signals out of the first downmix acoustic signal; a coded signal generating unit which generates: a second downmix acoustic signal and an extended signal based on each of coded signals inputted by the input unit, the second downmix acoustic signal being for obtaining each of the first downmix acoustic signals, and the generated extended signal being for obtaining each of the first downmix acoustic signals out of the second downmix acoustic signal; and generate a coded signal including the generated second downmix acoustic signal, the generated extended signal, and each of extended signals included in the corresponding inputted coded signal; and an output unit which outputs the generated coded signal.

## Claims

### Claim 1

A stream synthesizing device comprising:
an input unit configured to input at least two coded signals each including a first downmix acoustic signal and an extended signal, each of first downmix acoustic signals being obtained by coding an acoustic signal into which at least two sound signals are downmixed, and the extended signal being for obtaining the at least two sound signals out of the first downmix acoustic signal;
to a coded signal generating unit configured to generate: a second downmix acoustic signal and an extended signal based on each of coded signals inputted by said input unit, the second downmix acoustic signal being for obtaining each of the first downmix acoustic signals, and the generated extended signal being for obtaining each of the first downmix acoustic signals out of the second downmix acoustic signal; and generate a coded signal including the generated second downmix acoustic signal, the generated extended signal, and each of extended signals included in the corresponding inputted coded signal; and
an output unit configured to output the generated coded signal.

### Claim 2 (depends on 1)

The stream synthesizing device according to claim 1,
wherein said coded signal generating unit is configured to calculate an aggregate number of the at least two sound signals included in each of the coded signals inputted by said input unit, and the coded signal to be generated includes the calculated aggregate number of the at least two sound signals.

### Claim 3 (depends on 1)

The stream synthesizing device according to claim 1,
wherein the extended signal in the coded signal inputted by said input unit includes a plurality of partly extended signals, and some of the plurality of partly extended signals obtain a sound signal out of a coded signal, the some of the plurality of partly extended signals which are included in the plurality of partly extended signals being corresponding to the sound signal, and
said coded signal generating unit is configured to generate the coded signal storing the some of the plurality of partly extended signals corresponding to the sound signal being each of the at least two sound signals.

### Claim 4 (depends on 3)

The stream synthesizing device according to claim 3,
wherein said coded signal generating unit is configured to generate the coded signal including only a partly extended signal for obtaining a predetermined acoustic signal.

### Claim 5 (depends on 1)

The stream synthesizing device according to claim 1,
wherein said coded signal generating unit is configured to generate the coded signal including only extended signals in some of predetermined coded signals included in the at least two coded signals each being inputted by said input unit.

### Claim 6 (depends on 5)

The stream synthesizing device according to claim 5,
wherein said coded signal generating unit is configured to generate the coded signal only including an extended signal included in a coded signal inputted from an input source having a predetermined priority order higher than a predetermined reference order.

### Claim 7 (depends on 1)

The stream synthesizing device according to claim 1,
wherein the extended signal in the coded signal inputted by said input unit includes a plurality of partly extended signals, and a sound signal is obtained out of a coded signal with a use of some of the plurality of partly extended signals, included in the plurality of partly extended signals, corresponding to the sound signal, and
said coded signal generating unit is configured to generate the coded signal only including the some of the plurality of partly extended signals corresponding to a sound signal having a priority order higher than a predetermined reference order, the priority order being predetermined.

### Claim 8 (depends on 1)

The stream synthesizing device according to claim 1,
wherein the extended signal in the coded signal inputted by said input unit includes a plurality of partly extended signals, and a sound signal is decoded from a coded signal with a use of some of the plurality of partly extended signals, included in the plurality of partly extended signals, corresponding to the sound signal, and
said coded signal generating unit is configured to generate the coded signal including tree information specifying a tree structure constructed out of the extended signal and each of partly extended signals in the coded signal to be generated, the extended signal being generated by said coded signal generating unit.

### Claim 9 (depends on 1)

The stream synthesizing device according to claim 1,
wherein said coded signal generating unit is configured to generate the coded signal including determining information indicating the extended signal generated by said coded signal generating unit among the extended signal generated by said coded signal generating unit and each of the extended signals included in the associated one of at least two coded signals inputted by said input unit.

### Claim 10 (depends on 1)

The stream synthesizing device according to claim 1,
wherein each coded signal inputted by said input unit includes input source information indicating an input source from which the coded signal has been inputted, and
said coded signal generating unit is configured to: identify each of coded signals including input source information indicating a predetermined input source, each of the coded signals being included in the inputted each of at least two coded signals; generate the second downmix acoustic signal and an extended signal, the second downmix acoustic signal obtaining each of the first downmix acoustic signals in one of the associated identified coded signals, and the extended signal being for the obtaining; and generate the coded signal including the generated second downmix acoustic signal, the generated extended signal, and each of extended signals in one of the associated and identified coded signals.

### Claim 11 (depends on 1)

The stream synthesizing device according to claim 1,
wherein said input unit is configured to receive a coded signal from each of a plurality of predetermined input-output destinations,
said output unit is configured to output the coded signal to each of the plurality of input-output destinations,
said coded signal generating unit is configured to generate the second downmix acoustic signal and as many the extended signals as the number of the plurality of input-output destinations, the second downmix acoustic signal to be generated being generated one and a downmix acoustic signal for obtaining each of second downmix acoustic signals included in a corresponding one of the at least two coded signals inputted from one of the plurality of predetermined input-output destinations, and each of the extended signals, to be generated, which corresponds to a different associated one of the plurality of input-output destinations only including an extended signal of an input-output destination other than the corresponded input-output destination, and
said output unit is configured to output each of the coded signals which said coded signal generating unit generates to the associated one of the input-output destinations to which the extended information included in each of the coded signals corresponds, the extended information being generated by said coded signal generating unit.

### Claim 12 (depends on 1)

The stream synthesizing device according to claim 1,
wherein said coded signal generating unit includes:
a separating unit configured to separate the first downmix acoustic signal, included in each of the coded signals, from the coded signal inputted by said input unit;
a downmix acoustic signal generating unit configured to generate the second downmix acoustic signal based on each of the first downmix acoustic signals separated by said separating unit;
an extended signal generating unit configured to generate the extended signal based on each of the first downmix acoustic signals separated by said separating unit, the extended signal being for obtaining each of the first downmix acoustic signals out of the second down mix acoustic signal; and
a synthesizing unit configured to synthesize, for generating the coded signal, the second downmix acoustic signal generated by said downmix acoustic signal generating unit, the extended signal generated by said extended signal generating unit, and each of the extended signals included in associated one of the coded signal inputted by said input unit.

### Claim 13

A decoding device comprising
an input unit configured to input a coded signal including a downmix acoustic signal and an extended signal, the downmix acoustic signal being obtained by coding an acoustic signal into which at least two sound signals are downmixed, and the extended signal being for obtaining the at least two sound signals out of the downmix acoustic signal,
wherein the downmix acoustic signal in the coded signal to be inputted is a second downmix acoustic signal for obtaining each of downmix acoustic signals in predetermined at least two coded signals,
the extended signal in the coded signal to be inputted is an extended signal for obtaining each of the first downmix acoustic signals out of the second downmix acoustic signal, and
said decoding unit includes a decoding sub-unit configured to generate at least two intermediate signals based at least on a interaural correlation coefficient (ICC) and a frequency interaural level difference (ILD) included in the extended signal, and to multiply the generated at least two intermediate signals by the frequency interaural level difference (ILD), the at least two intermediate signals being uncorrelated out of a decoded signal obtained from the second downmix acoustic signal with a use of the interaural correlation coefficient (ICC).

### Claim 14

A stream synthesizing method comprising:
inputting at least two coded signals each including a first downmix acoustic signal and an extended signal, each of first downmix acoustic signals being obtained by coding an acoustic signal into which at least two sound signals are downmixed, and the extended signal being for obtaining the at least two sound signals out of the first downmix acoustic signal,
generating: a second downmix acoustic signal and an extended signal based on each of coded signals inputted in said inputting, the second downmix acoustic signal being for obtaining each of the first downmix acoustic signals, and the generated extended signal being for obtaining each of the first downmix acoustic signals out of the second downmix acoustic signal; and a coded signal including the generated second downmix acoustic signal, the generated extended signal, and each of extended signals included in the corresponding inputted coded signal; and
outputting the generated coded signal.

### Claim 15

A computer program which causes a computer to execute:
inputting at least two coded signals each including a first downmix acoustic signal and an extended signal, each of first downmix acoustic signals being obtained by coding an acoustic signal into which at least two sound signals are downmixed, and the extended signal being for obtaining the at least two sound signals out of the first downmix acoustic signal,
generating: a second downmix acoustic signal and an extended signal based on each of coded signals inputted in said inputting, the second downmix acoustic signal being for obtaining each of the first downmix acoustic signals, and the generated extended signal being for obtaining each of the first downmix acoustic signals out of the second downmix acoustic signal; and a coded signal including the generated second downmix acoustic signal, the generated extended signal, and each of extended signals included in the corresponding inputted coded signal; and
outputting the generated coded signal.

### Claim 16

A decoding method comprising
inputting a coded signal including a downmix acoustic signal and an extended signal, the downmix acoustic signal being provided out of a coded acoustic signal into which at least two sound signals are downmixed, and the extended signal being for obtaining the at least two sound signals out of the downmix acoustic signal,
wherein the downmix acoustic signal in the coded signal to be inputted is a second downmix acoustic signal for obtaining each of downmix acoustic signals in predetermined at least two coded signals,
the extended signal in the coded signal to be inputted is an extended signal for obtaining each of the first downmix acoustic signals out of the second downmix acoustic signal, and
said decoding method includes generating at least two intermediate signals based at least on a interaural correlation coefficient (ICC) and a frequency interaural level difference (ILD) included in the extended signal, and multiplying the generated at least two intermediate signals by the frequency interaural level difference (ILD), the at least two intermediate signals being uncorrelated out of a decoded signal obtained from the second downmix acoustic signal with a use of the interaural correlation coefficient (ICC).

### Claim 17

A computer program which causes a computer to execute:
inputting a coded signal including a downmix acoustic signal and an extended signal, the downmix acoustic signal being provided out of a coded acoustic signal into which at least two sound signals are downmixed, and the extended signal being for obtaining the at least two sound signals out of the downmix acoustic signal,
wherein the downmix acoustic signal in the coded signal to be inputted is a second downmix acoustic signal for obtaining each of downmix acoustic signals in predetermined at least two coded signals,
the extended signal in the coded signal to be inputted is an extended signal for obtaining each of the first downmix acoustic signals out of the second downmix acoustic signal, and
said computer program causes the computer to execute generating at least two intermediate signals based at least on a interaural correlation coefficient (ICC) and a frequency interaural level difference (ILD) included in the extended signal, and multiplying the generated at least two intermediate signals by the frequency interaural level difference (ILD), the at least two intermediate signals being uncorrelated out of a decoded signal obtained from the second downmix acoustic signal with a use of the interaural correlation coefficient (ICC).
