# US 2022/0277754 A1 · Multi-lag format for audio coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0277754 A1
- Document ID: US20220277754A1
- Status: Published application
- Kind: A1
- Application number: 17/636,856
- Filed: 2020-08-18
- Published: 2022-09-01
- Earliest claimed: 2019-08-20
- Assignees: Dolby International AB
- Applicants: Dolby International AB
- Inventors: Lars Villemoes; Heidi-Maria Lehtonen; Heiko Purnhagen; Per Hedelin
- Web page: https://patentgrep.com/patent/US20220277754A1

## CPC

- G10L 19/0204: {using subband decomposition}
- G10L 19/24: Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
- G10L 25/06: the extracted parameters being correlation coefficients
- G10L 25/18: the extracted parameters being spectral information of each sub-band
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Described herein is a method of encoding an audio signal. The method comprises: generating a plurality of subband audio signals based on the audio signal; determining a spectral envelope of the audio signal; for each subband audio signal, determining autocorrelation information for the subband audio signal based on an autocorrelation function of the subband audio signal; and generating an encoded representation of the audio signal, the encoded representation comprising a representation of the spectral envelope of the audio signal and a representation of the autocorrelation information for the plurality of subband audio signals. Further described are methods of decoding the audio signal from the encoded representation, as well as corresponding encoders, decoders, computer programs, and computer-readable recording media.

## Claims

### Claim at position 1

-33. (canceled)

### Claim 34

A method of encoding an audio signal, the method comprising:
generating a plurality of subband audio signals based on the audio signal;
determining a spectral envelope of the audio signal;
for each subband audio signal, determining autocorrelation information for the subband audio signal based on an autocorrelation function of the subband audio signal, wherein the autocorrelation information comprises an autocorrelation value for the subband audio signal; and
encoding into an encoded representation of the audio signal the spectral envelope of the audio signal and the autocorrelation information for the plurality of subband audio signals,
wherein the autocorrelation information for a given subband audio signal further comprises a lag value for the respective subband audio signal.

### Claim 35 (depends on 34)

The method according to claim 34, wherein the lag value corresponds to a delay value for which the autocorrelation function attains a local maximum, and wherein the autocorrelation value corresponds to said local maximum.

### Claim 36 (depends on 34)

The method according to claim 34, wherein the spectral envelope is determined at a first update rate and the autocorrelation information for the plurality of subband audio signals is determined at a second update rate; and
wherein the first and second update rates are different from each other.

### Claim 37 (depends on 36)

The method according to claim 36, wherein the first update rate is higher than the second update rate.

### Claim 38 (depends on 34)

The method according to claim 34, wherein generating the plurality of subband audio signals comprises:
applying spectral and/or temporal flattening to the audio signal;
windowing the flattened audio signal; and
spectrally decomposing the windowed flattened audio signal into the plurality of subband audio signals.

### Claim 39 (depends on 34)

The method according to claim 34,
wherein generating the plurality of subband audio signals comprises spectrally decomposing the audio signal; and
wherein determining the autocorrelation function for a given subband audio signal comprises:
determining a subband envelope of the subband audio signal;
envelope-flattening the subband audio signal based on the subband envelope;
windowing the envelope-flattened subband audio signal by a window function; and
determining the autocorrelation function of the windowed envelope-flattened subband audio signal.

### Claim 40 (depends on 38)

The method according to claim 38, wherein determining the autocorrelation function for a given subband audio signal further comprises:
normalizing the autocorrelation function of the windowed envelope-flattened subband audio signal by an autocorrelation function of the window function.

### Claim 41 (depends on 34)

The method according to claim 34, wherein determining the autocorrelation information for a given subband audio signal based on the autocorrelation function of the subband audio signal comprises:
comparing the autocorrelation function of the subband audio signal to an autocorrelation function of an absolute value of an impulse response of a respective bandpass filter associated with the subband audio signal; and
determining the autocorrelation information based on a highest local maximum of the autocorrelation function of the subband signal above the autocorrelation function of the absolute value of the impulse response of the respective bandpass filter associated with the subband audio signal.

### Claim 42

A method of decoding an audio signal from an encoded representation of the audio signal, the encoded representation including a spectral envelope of the audio signal and autocorrelation information for each of a plurality of subband audio signals generated from the audio signal, wherein the autocorrelation information for a given subband audio signal is based on an autocorrelation function of the subband audio signal, the method comprising:
receiving the encoded representation of the audio signal;
extracting the spectral envelope and the autocorrelation information from the encoded representation of the audio signal; and
determining a reconstructed audio signal based on the spectral envelope and the autocorrelation information,
wherein the autocorrelation information for a given subband audio signal comprises an autocorrelation value for the subband audio signal and a lag value for the respective subband audio signal.

### Claim 43 (depends on 42)

The method according to claim 42, wherein the reconstructed audio signal is determined such that the autocorrelation function for each of a plurality of subband signals generated from the reconstructed audio signal satisfies a condition derived from the autocorrelation information for the corresponding subband audio signals generated from the audio signal.

### Claim 44 (depends on 42)

The method according to claim 42, wherein the reconstructed audio signal is determined such that autocorrelation information for each of the plurality of subband signals of the reconstructed audio signal matches, up to a predefined margin, the autocorrelation information for the corresponding subband audio signal of the audio signal.

### Claim 45 (depends on 42)

The method according to claim 42, wherein the reconstructed audio signal is determined such that for each subband audio signal of the reconstructed audio signal, the value of the autocorrelation function of the subband audio signal of the reconstructed audio signal at the lag value indicated by the autocorrelation information for the corresponding subband audio signal of the audio signal matches, up to a predefined margin, the autocorrelation value indicated by the autocorrelation information for the corresponding subband audio signal of the audio signal.

### Claim 46 (depends on 42)

The method according to claim 42, wherein the reconstructed audio signal is further determined such that for each subband audio signal of the reconstructed audio signal, a measured signal power of the subband audio signal of the reconstructed audio signal matches, up to a predefined margin, a signal power for the corresponding subband audio signal of the audio signal that is indicated by the spectral envelope.

### Claim 47 (depends on 42)

The method according to claim 42,
wherein the reconstructed audio signal is determined in an iterative procedure that starts out from an initial candidate for the reconstructed audio signal and generates a respective intermediate reconstructed audio signal at each iteration; and
wherein at each iteration, an update map is applied to the intermediate reconstructed audio signal to obtain the intermediate reconstructed audio signal for the next iteration, in such manner that a difference between an encoded representation of the intermediate reconstructed audio signal and the encoded representation of the audio signal becomes successively smaller from one iteration to another.

### Claim 48 (depends on 42)

The method according to claim 42, wherein determining the reconstructed audio signal based on the spectral envelope and the autocorrelation information comprises applying a machine learning based generative model that receives the spectral envelope of the audio signal and the autocorrelation information for each of the plurality of subband audio signals of the audio signal as an input and that generates and outputs the reconstructed audio signal.

### Claim 49 (depends on 48)

The method according to claim 48, wherein the machine learning based generative model comprises a parametric conditional distribution that relates encoded representations of audio signals and corresponding audio signals to respective probabilities; and
wherein determining the reconstructed audio signal comprises sampling from the parametric conditional distribution for the encoded representation of the audio signal.

### Claim 50 (depends on 48)

The method according to claim 48, wherein the machine learning based generative model is one of a recurrent neural network, a variational autoencoder, or a generative adversarial model.

### Claim 51 (depends on 43)

The method according to claim 43, wherein determining the reconstructed audio signal based on the spectral envelope and the autocorrelation information comprises:
determining a plurality of reconstructed subband audio signals based on the spectral envelope and the autocorrelation information; and
determining a reconstructed audio signal based on the plurality of reconstructed subband audio signals by spectral synthesis,
wherein the plurality of reconstructed subband audio signals are determined such that for each reconstructed subband audio signal, the autocorrelation function of the reconstructed subband audio signal satisfies a condition derived from the autocorrelation information for the corresponding subband audio signal of the audio signal.

### Claim 52 (depends on 51)

The method according to claim 51, wherein the plurality of reconstructed subband audio signals are determined such that autocorrelation information for each reconstructed subband audio signal matches, up to a predefined margin, the autocorrelation information for the corresponding subband audio signal of the audio signal.

### Claim 53 (depends on 51)

The method according to claim 51, wherein the plurality of reconstructed subband audio signals are determined such that for each reconstructed subband audio signal, the value of the autocorrelation function of the reconstructed subband audio signal at the lag value indicated by the autocorrelation information for the corresponding subband audio signal of the audio signal matches, up to a predefined margin, an autocorrelation value indicated by the autocorrelation information for the corresponding subband audio signal of the audio signal.
