# US 2019/0378523 A1 · Coding of multiple audio signals

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378523 A1
- Document ID: US20190378523A1
- Status: Published application
- Kind: A1
- Application number: 16/547,226
- Filed: 2019-08-21
- Published: 2019-12-12
- Earliest claimed: 2017-01-19
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Venkatraman ATTI; Venkata Subrahmanyam Chandra Sekhar CHEBIYYAM
- Web page: https://patentgrep.com/patent/US20190378523A1

## CPC

- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- H04R 5/02: Spatial or constructional arrangements of loudspeakers
- H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction
- H04S 2420/03: Application of parametric coding in stereophonic audio systems
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04S: STEREOPHONIC SYSTEMS
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

A device includes a processor that is configured to determine an inter-channel mismatch value indicative of a temporal misalignment between a frequency-domain reference channel and a frequency-domain target channel. The processor is also configured to adjust the frequency-domain target channel based on the inter-channel mismatch value to generate an adjusted frequency-domain target channel. The processor is further configured to perform a down-mix operation, based on the frequency-domain reference channel and the adjusted frequency-domain target channel, to generate a mid channel and a side channel. The processor is also configured to generate a predicted side channel based on the mid channel. The processor is further configured to generate a residual channel based on the side channel and the predicted side channel. The processor is also configured to encode the residual channel as part of a bitstream.

## Claims

### Claim 1

A device comprising:
a processor configured to:
determine an inter-channel mismatch value indicative of a temporal misalignment between a frequency-domain reference channel and a frequency-domain target channel;
adjust the frequency-domain target channel based on the inter-channel mismatch value to generate an adjusted frequency-domain target channel;
perform a down-mix operation, based on the frequency-domain reference channel and the adjusted frequency-domain target channel, to generate a mid channel and a side channel;
generate a predicted side channel based on the mid channel;
generate a residual channel based on the side channel and the predicted side channel; and
encode the residual channel as part of a bitstream; and
a memory configured to store the inter-channel mismatch value.

### Claim 2 (depends on 1)

The device of claim 1, wherein the processor is further configured to scale the residual channel by a scaling factor to generate a scaled residual channel, wherein the residual channel is encoded as part of the bitstream by encoding the scaled residual channel as part of the bitstream.

### Claim 3 (depends on 2)

The device of claim 2, wherein the scaling factor is based on the inter-channel mismatch value.

### Claim 4 (depends on 2)

The device of claim 2, wherein the processor is further configured to set a number of bits used to encode the scaled residual channel in the bitstream based on the inter-channel mismatch value.

### Claim 5 (depends on 2)

The device of claim 2, wherein the processor is further configured to compare the inter-channel mismatch value to a threshold.

### Claim 6 (depends on 5)

The device of claim 5, wherein, in response to the inter-channel mismatch value being less than or equal to the threshold, a first number of bits is used to encode the scaled residual channel.

### Claim 7 (depends on 6)

The device of claim 6, wherein, in response to the inter-channel mismatch value being greater than the threshold, a second number of bits is used to encode the scaled residual channel.

### Claim 8 (depends on 7)

The device of claim 7, wherein the second number of bits is different from the first number of bits.

### Claim 9 (depends on 7)

The device of claim 7, wherein the second number of bits is less than the first number of bits.

### Claim 10 (depends on 1)

The device of claim 1, wherein the processor is further configured to determine a residual gain parameter based on the inter-channel mismatch value.

### Claim 11 (depends on 1)

The device of claim 1, wherein one or more bands of the residual channel are zeroed out based on the inter-channel mismatch value.

### Claim 12 (depends on 1)

The device of claim 1, wherein each band of the residual channel is zeroed out based on the inter-channel mismatch value.

### Claim 13 (depends on 1)

The device of claim 1, wherein the processor is further configured to:
perform a first transform operation on a reference channel to generate the frequency-domain reference channel; and
perform a second transform operation on a target channel to generate the frequency-domain target channel.

### Claim 14 (depends on 1)

The device of claim 1, wherein the processor is further configured to encode the mid channel as part of the bitstream.

### Claim 15 (depends on 1)

The device of claim 1, wherein the residual channel comprises an error channel signal.

### Claim 16 (depends on 1)

The device of claim 1, wherein the processor and the memory are integrated into a mobile device.

### Claim 17 (depends on 1)

The device of claim 1, wherein the processor and memory are integrated into a base station.

### Claim 18 (depends on 1)

The device of claim 1, further comprising a transmitter configured to transmit the bitstream.

### Claim 19

A method of communication, the method comprising:
determining an inter-channel mismatch value indicative of a temporal misalignment between a frequency-domain reference channel and a frequency-domain target channel;
adjusting the frequency-domain target channel based on the inter-channel mismatch value to generate an adjusted frequency-domain target channel;
performing a down-mix operation, based on the frequency-domain reference channel and the adjusted frequency-domain target channel, to generate a mid channel and a side channel;
generating a predicted side channel based on the mid channel;
generating a residual channel based on the side channel and the predicted side channel;
and
encoding the residual channel as part of a bitstream.

### Claim 20 (depends on 19)

The method of claim 19, further comprising scaling the residual channel by a scaling factor to generate a scaled residual channel, wherein encoding the residual channel as part of the bitstream includes encoding the scaled residual channel as part of the bitstream.

### Claim 21 (depends on 20)

The method of claim 20, wherein the scaling factor is based on the inter-channel mismatch value.

### Claim 22 (depends on 19)

The method of claim 19, wherein one or more bands of the residual channel are zeroed out based on the inter-channel mismatch value.

### Claim 23 (depends on 19)

The method of claim 19, wherein each band of the residual channel is zeroed out based on the inter-channel mismatch value.

### Claim 24 (depends on 19)

The method of claim 19, wherein adjusting the frequency-domain target channel is performed at a mobile device.

### Claim 25 (depends on 19)

The method of claim 19, wherein adjusting the frequency-domain target channel is performed at a base station.

### Claim 26

A non-transitory computer-readable medium comprising instructions that, when executed by a processor within an encoder, cause the processor to perform operations comprising:
determining an inter-channel mismatch value indicative of a temporal misalignment between a frequency-domain reference channel and a frequency-domain target channel;
adjusting the frequency-domain target channel based on the inter-channel mismatch value to generate an adjusted frequency-domain target channel;
performing a down-mix operation, based on the frequency-domain reference channel and the adjusted frequency-domain target channel, to generate a mid channel and a side channel;
generating a predicted side channel based on the mid channel;
generating a residual channel based on the side channel and the predicted side channel;
and
encoding the residual channel as part of a bitstream.

### Claim 27 (depends on 26)

The non-transitory computer-readable medium of claim 26, wherein the residual channel comprises an error channel signal.

### Claim 28

An apparatus comprising:
means for adjusting a frequency-domain target channel based on an inter-channel mismatch value to generate an adjusted frequency-domain target channel, the inter-channel mismatch value indicative of a temporal misalignment between a frequency-domain reference channel and the frequency-domain target channel;
means for performing a down-mix operation, based on the frequency-domain reference channel and the adjusted frequency-domain target channel, to generate a mid channel and a side channel; and
means for generating a residual channel based on the side channel and a predicted side channel, the residual channel to be encoded as part of a bitstream.

### Claim 29 (depends on 28)

The apparatus of claim 28, wherein the means for adjusting the frequency-domain target channel, the means for performing the down-mix operation, and the means for generating the residual channel are integrated into a mobile device.

### Claim 30 (depends on 28)

The apparatus of claim 28, wherein the means for adjusting the frequency-domain target channel, the means for performing the down-mix operation, and the means for generating the residual channel are integrated into a base station.
