# US 2018/0322884 A1 · Apparatus and Method for Estimating an Inter-Channel Time Difference

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322884 A1
- Document ID: US20180322884A1
- Status: Published application
- Kind: A1
- Application number: 16/035,456
- Filed: 2018-07-13
- Published: 2018-11-08
- Earliest claimed: 2016-01-22
- Assignees: Fraunhofer-Gesellschaft zur Foerderung der andgewandten Forschung e.V.
- Applicants: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Inventors: Stefan BAYER; Eleni FOTOPOULOU; Markus MULTRUS; Guillaume FUCHS; Emmanuel RAVELLI; Markus SCHNELL; Stefan DOEHLA; Wolfgang JAEGERS; Martin DIETZ; Goran MARKOVIC
- Web page: https://patentgrep.com/patent/US20180322884A1

## CPC

- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- G10L 19/02: using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L 19/022: Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
- G10L 19/04: using predictive techniques
- G10L 25/18: the extracted parameters being spectral information of each sub-band
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/03: Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence)
- H04S 2420/03: Application of parametric coding in stereophonic audio systems
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04S: STEREOPHONIC SYSTEMS

## Abstract

An apparatus for estimating an inter-channel time difference between a first channel signal and a second channel signal, includes: a calculator for calculating a cross-correlation spectrum for a time block from the first channel signal in the time block and the second channel signal in the time block; a spectral characteristic estimator for estimating a characteristic of a spectrum of the first channel signal or the second channel signal for the time block; a smoothing filter for smoothing the cross-correlation spectrum over time using the spectral characteristic to obtain a smoothed cross-correlation spectrum; and a processor for processing the smoothed cross-correlation spectrum to obtain the inter-channel time difference.

## Claims

### Claim 1

An apparatus for estimating an inter-channel time difference between a first channel signal and a second channel signal, comprising:
a calculator for calculating a cross-correlation spectrum for a time block from the first channel signal in the time block and the second channel signal in the time block;
a spectral characteristic estimator for estimating a characteristic of a spectrum of the first channel signal or the second channel signal for the time block;
a smoothing filter for smoothing the cross-correlation spectrum over time using the spectral characteristic to acquire a smoothed cross-correlation spectrum; and
a processor for processing the smoothed cross-correlation spectrum to acquire the inter-channel time difference.

### Claim 2 (depends on 1)

The apparatus of claim 1,
wherein the processor is configured to normalize the smoothed cross-correlation spectrum using a magnitude of the smoothed cross-correlation spectrum.

### Claim 3 (depends on 1)

The apparatus of claim 1,
wherein the processor is configured
to calculate a time-domain representation of the smoothed cross-correlation spectrum or a normalized smoothed cross-correlation spectrum; and
to analyze the time-domain representation to determine the inter-channel time difference.

### Claim 4 (depends on 1)

The apparatus of claim 1,
wherein the processor is configured to low-pass filter the time-domain representation and to further process a result of the low-pass filtering.

### Claim 5 (depends on 1)

The apparatus of claim 1,
wherein the processor is configured to perform the inter-channel time difference determination by performing a peak searching or peak picking operation within a time-domain representation determined from the smoothed cross-correlation spectrum.

### Claim 6 (depends on 1)

The apparatus of claim 1,
wherein the spectral characteristic estimator is configured to determine, as the spectral characteristic, a noisiness or a tonality of the spectrum; and
wherein the smoothing filter is configured to apply a stronger smoothing over time with a first smoothing degree in case of a first less noisy characteristic or a first more tonal characteristic, or to apply a weaker smoothing over time with a second smoothing degree in case of a second more noisy characteristic or a second less tonal characteristic,
wherein the first smoothing degree is greater than the second smoothing degree, and wherein the first noisy characteristic is less noisy than the second noisy characteristic, or the first tonal characteristic is more tonal than the second tonal characteristic.

### Claim 7 (depends on 1)

The apparatus of claim 1,
wherein the spectral characteristics estimator is configured to calculate, as the characteristic, a first spectral flatness measure of a spectrum of the first channel signal and a second spectral flatness measure of a second spectrum of the second channel signal, and to determine the characteristic of the spectrum from the first and the second spectral flatness measure by selecting a maximum value, by determining a weighted average or an unweighted average between the spectral flatness measures, or by selecting a minimum value.

### Claim 8 (depends on 1)

The apparatus of claim 1,
wherein the smoothing filter is configured to calculate a smoothed cross-correlation spectrum value for a frequency by a weighted combination of the cross-correlation spectrum value for the frequency from the time block and a cross-correlation spectral value for the frequency from at least one past time block, wherein weighting factors for the weighted combination are determined by the characteristic of the spectrum.

### Claim 9 (depends on 1)

The apparatus of claim 1,
wherein the processor is configured to determine a valid range and an invalid range within a time-domain representation derived from the smoothed cross-correlation spectrum,
wherein at least one maximum peak within the invalid range is detected and compared to a maximum peak within the valid range, wherein the inter-channel time difference is only determined, when the maximum peak within the valid range is greater than at least one maximum peak within the invalid range.

### Claim 10 (depends on 1)

The apparatus of claim 1,
wherein the processor is configured
to perform a peak search operation within a time-domain representation derived from the smoothed cross-correlation spectrum,
to determine a variable threshold from the time-domain representation; and
to compare a peak to the variable threshold, wherein the inter-channel time difference is determined as a time lag associated with a peak being in a predetermined relation to the variable threshold.

### Claim 11 (depends on 10)

The apparatus of claim 10,
wherein the processor is configured to determine the variable threshold as a value being equal to an integer multiple of a value among the largest 10% of values of the time-domain representation.

### Claim 12 (depends on 1)

The apparatus of claim 1,
wherein the processor is configured to determine a maximum peak amplitude in each subblock of a plurality of subblocks of a time-domain representation derived from the smoothed cross-correlation spectrum,
wherein the processor is configured to calculate a variable threshold based on a mean peak magnitude derived from the maximum peak magnitudes of the plurality of sub-blocks, and
wherein the processor is configured to determine the inter-channel time difference as a time lag value corresponding to a maximum peak of the plurality of subblocks being greater than the variable threshold.

### Claim 13 (depends on 12)

The apparatus of claim 12,
wherein the processor is configured to calculate the variable threshold by a multiplication of the mean threshold determined as an average peak among the peaks in the subblocks and a value,
wherein the value is determined by an SNR (signal to noise ratio) characteristic of the first and the second channel signal, wherein a first value is associated with a first SNR value and a second value is associated with a second SNR value, wherein the first value is greater than the second value, and wherein the first SNR value is greater than the second SNR value.

### Claim 14 (depends on 13)

The apparatus of claim 13,
wherein the processor is configured to use a third value being lower than the second value in case of a third SNR value being lower than the second SNR value and when a difference between the threshold and a maximum peak is lower than a predetermined value.

### Claim 15

A method for estimating an inter-channel time difference between a first channel signal and a second channel signal, comprising:
calculating a cross-correlation spectrum for a time block from the first channel signal in the time block and the second channel signal in the time block;
estimating a characteristic of a spectrum of the first channel signal or the second channel signal for the time block;
smoothing the cross-correlation spectrum over time using the spectral characteristic to acquire a smoothed cross-correlation spectrum; and
processing the smoothed cross-correlation spectrum to acquire the inter-channel time difference.

### Claim 16

A non-transitory digital storage medium having a computer program stored thereon to perform the method for estimating an inter-channel time difference between a first channel signal and a second channel signal, comprising:
calculating a cross-correlation spectrum for a time block from the first channel signal in the time block and the second channel signal in the time block;
estimating a characteristic of a spectrum of the first channel signal or the second channel signal for the time block;
smoothing the cross-correlation spectrum over time using the spectral characteristic to acquire a smoothed cross-correlation spectrum; and
processing the smoothed cross-correlation spectrum to acquire the inter-channel time difference,
when said computer program is run by a computer.
