# US 2010/0169102 A1 · Low complexity mpeg encoding for surround sound recordings

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0169102 A1
- Document ID: US20100169102A1
- Status: Published application
- Kind: A1
- Application number: 12/405,133
- Filed: 2009-03-16
- Published: 2010-07-01
- Earliest claimed: 2008-12-30
- Assignees: STMicroelectronics Asia Pacific Pte.Ltd.
- Inventors: Samsudin .; Sapna George
- Web page: https://patentgrep.com/patent/US20100169102A1

## CPC

- G10L 19/0208: {Subband vocoders}
- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

The invention provides for the encoding of surround sound produced by any coincident microphone techniques with coincident-to-virtual microphone signal matrixing. An encoding scheme provides significantly lower computational demand, by deriving the spatial parameters and output downmixes from the coincident microphone array signals and the coincident-to-surround channel-coefficients matrix, instead of the multi-channel signals.

## Claims

### Claim 1

A method for MPEG Surround spatial audio encoding of coincident surround sound recordings, the scheme comprising:
conducting time-frequency subband analysis filtering of time-domain coincident microphone array signals producing a plurality of subband-domain coincident microphone array signals;
determining microphone signal energy and cross-correlation parameters for each of a plurality of MPEG Surround parameter bands, said bands associated with each of the plurality of subband-domain coincident microphone array signals, forming a plurality of parameter band values;
determining required spatial parameters based on the plurality of parameter band values and a plurality of subband-domain coincident-to-surround channel coefficients, said subband-domain coincident-to-surround channel coefficients being in a matrix that maps the subband-domain coincident microphone array signals to subband-domain multi-channel surround signals; and
downmixing the plurality of subband-domain coincident-to-surround channel coefficients through a spatial encoding tree to derive a plurality of output-downmix channel coefficients.

### Claim 2 (depends on 1)

The method of claim 1 wherein said plurality of output-downmix channel coefficients are in a matrix mapping subband-domain coincident microphone array signals to subband-domain output-downmix signals suitable for MPEG Surround spatial audio decoding.

### Claim 3 (depends on 1)

The method of claim 1 wherein energy of each subband-domain coincident microphone array signal and cross-correlations between pairs of the subband-domain coincident microphone array signals are calculated and grouped according to at least one MPEG Surround parameter band and a resulting band value form a common input to all Two-to-One and Three-to-Two encoding blocks.

### Claim 4 (depends on 1)

The method of claim 1 wherein spatial encoding at each encoding block of the spatial encoding tree is based on a common input and subband-domain coincident-to-surround channel coefficients.

### Claim 5 (depends on 4)

The method of claim 4 wherein parameter-band energies and cross-correlations of input signals of Two-to-One encoding blocks or Three-to-Two encoding blocks are determined from the common input and a corresponding triplet pair of coincident-to-surround channel coefficients, and wherein these parameter-band energies and cross-correlations are utilized to calculate required spatial parameters and downmix scale factors.

### Claim 6 (depends on 4)

The method according to claim 4 wherein the subband-domain input-channel coefficients are summed, scaled and navigated through the spatial encoding tree to derive output-downmix channel coefficients.

### Claim 7 (depends on 4)

The method according to claim 4 wherein a pair or triplet of subband-domain coincident-to-surround channel coefficients are subtracted from each other and then adjusted to derive residual channel coefficients of a corresponding encoding block.

### Claim 8 (depends on 4)

The method of claim 4 wherein the subband-domain coincident-to-surround channel coefficients are combined resulting in mixed subband-domain coincident-to-surround channel coefficients and wherein the mixed subband-domain coincident-to-surround channel coefficients are multiplied with said downmix scale factors to result in downmix channel coefficients that are passed to subsequent encoding blocks as subband-domain coincident-to-surround channel coefficients.

### Claim 9 (depends on 8)

The method of claim 8 wherein the dowmnix channel coefficients of a last encoding block in the encoding tree form an output-downmix channel matrix.

### Claim 10 (depends on 8)

The method of claim 8 wherein output-downmix and residual signals are derived by matrixing the subband-domain coincident microphone array signals with the output-downmix and residual channel coefficients.

### Claim 11 (depends on 8)

The method according to claim 8 further comprising multiplying the output-downmix channel coefficient matrix with a stereo-downmix conversion matrix to convert default stereo output-downmix signals into matrix-compatible or 3D stereo processed signals.

### Claim 12 (depends on 1)

The method of claim 1 wherein spatial parameters and output-downmix signals are derived from subband-domain coincident microphone array signals and the coincident-to-surround channel-coefficients.

### Claim 13 (depends on 1)

The method of claim 1 wherein output-downmix signals from the subband-domain coincident microphone array signals are based on the output-downmix channel coefficients.

### Claim 14

A method for encoding coincident surround sound recordings, the method comprising deriving spatial parameters and output downmixes from a coincident microphone signal array and a coincident-to-surround channel coefficent matrix.

### Claim 15

A computer system for encoding coincident surround sound recordings the computer system comprising:
a machine capable of executing instructions embodied as software; and
a plurality of software portions, wherein
one of said software portions is configured to conduct time-frequency subband analysis filtering of time-domain coincident micro-phone array signals producing a plurality of subband-domain coincident microphone array signals;
one of said software portions is configured to determine microphone signal energy and cross-correlation parameters for each of a plurality of MPEG Surround parameter bands forming a plurality of parameter band values;
one of said software portions is configured to determine required spatial parameters based on the plurality of parameter band values and a plurality of subband-domain coincident-to-surround channel coefficients, said subband-domain coincident-to-surround channel coefficients being in a matrix that maps the subband-domain coincident microphone array signals to subband-doman multi-channel surround signals; and
one of said software portions is configured to downmix the plurality of subband-domain coincident-to-surround channel coefficients through a spatial encoding tree to derive a plurality of output-downmix channel coefficients.

### Claim 16 (depends on 15)

The computer system of claim 15 wherein one of said software programs is configured to calculate and group energy of each subband-domain coincident microphone array signal and cross-correlations between pairs of the subband-domain coincident microphone array signals according to at least one MPEG Surround parameter band and a resulting band value from a common input to all Two-to-One and Three-to-Two encoding blocks.

### Claim 17 (depends on 16)

The computer system of claim 16 wherein spatial encoding at each encoding block of the spatial encoding tree is based on a common input and subband-domain coincident-to-surround channel coefficients.

### Claim 18 (depends on 17)

The computer system of claim 17 wherein one of said software portions is configured to determine parameter-band energies and cross-correlations of Two-to-One encoding blocks or Three-to-Two encoding blocks from the common input and a corresponding triplet or pair of coincident-to-surround channel coefficients, and wherein these parameter-band energies and cross-correlations are utilized to calculate required spatial parameters and downmix scale factors.

### Claim 19 (depends on 15)

The computer system of claim 15 wherein one of said software portions is configured to derive spatial parameters and output-downmix signals from subband-domain coincident microphone array signals and the coincident-to-surround channel-coefficients.

### Claim 20

A computer-readable storage medium tangibly embodying a program of instructions executable by a machine wherein said program of instruction comprises a plurality of program codes for encoding coincident surround sound recordings, said program of instructions comprising program code for deriving spatial parameters and output downmixes from a coincident microphone signal array and a coincident-to-surround channel-coefficient matrix.
