# US 2024/0428814 A1 · Audio coding using combination of machine learning based time-varying filter and linear predictive coding filter

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0428814 A1
- Document ID: US20240428814A1
- Status: Published application
- Kind: A1
- Application number: 18/689,054
- Filed: 2022-10-10
- Published: 2024-12-26
- Earliest claimed: 2021-10-14
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Duminda DEWASURENDRA; Guillaume Konrad SAUTIERE; Zisis Iason SKORDILIS; Vivek RAJENDRAN
- Web page: https://patentgrep.com/patent/US20240428814A1

## CPC

- G10L 19/08: Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/09: Supervised learning
- G10L 19/12: the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
- G10L 19/26: Pre-filtering or post-filtering
- G10L 25/24: the extracted parameters being the cepstrum
- G10L 25/30: using neural networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G10L 19/06: Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients
- G10L 19/087: using mixed excitation models, e.g. MELP, MBE, split band LPC or HVXC
- G10L 19/093: using sinusoidal excitation models
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Systems and techniques are described for coding audio signals. For example, a voice decoder can generate, using a neural network, an excitation signal for at least one sample of an audio signal based on one or more inputs to the neural network, the excitation signal being configured to excite a linear predictive coding (LPC) filter. The voice decoder can further generate, using the LPC filter based on the excitation signal, at least one sample of a reconstructed audio signal. For example, the neural network can generate coefficients for one or more linear time-varying filters (e.g., a linear time-varying harmonic filter and a linear time-varying noise filter). The voice decoder can use the one or more linear time-varying filters including the generated coefficients to generate the excitation signal.

## Claims

### Claim 1

An apparatus for reconstructing one or more audio signals, comprising:
at least one memory configured to store audio data; and
at least one processor coupled to the at least one memory, the at least one processor configured to:
generate, using a neural network, an excitation signal for at least one sample of an audio signal based on one or more inputs to the neural network, the excitation signal being configured to excite a linear predictive coding (LPC) filter; and
generate, using the LPC filter based on the excitation signal, at least one sample of a reconstructed audio signal.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the one or more inputs to the neural network include features associated with the audio signal.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the features include log-Mel-frequency spectrum features.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the LPC filter is a time-varying LPC filter.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the at least one processor is configured to:
use filter coefficients of the LPC filter to generate the at least one sample of the reconstructed audio signal.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the filter coefficients of the LPC filter are generated based on an autocorrelation of an input audio signal in a voice encoder.

### Claim 7 (depends on 5)

The apparatus of claim 5, wherein the at least one processor is configured to:
derive the filter coefficients of the LPC filter based on features received from a voice encoder.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the features include Mel spectrum features.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the at least one processor is configured to:
input a pulse train signal based on pitch features to a harmonic filter generated using the neural network;
generate a harmonic filter output;
input a random noise signal to a noise filter generated using the neural network; and
generate a noise filter output; and
wherein, to generate the excitation signal, the at least one processor is configured to combine the harmonic filter output with the noise filter output.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein, to generate the excitation signal for the at least one sample of the audio signal using the neural network, the at least one processor is configured to:
generate, using the neural network, coefficients for one or more linear time-varying filters; and
generate, using the one or more linear time-varying filters including the generated coefficients, the excitation signal.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the one or more linear time-varying filters include a linear time-varying harmonic filter and a linear time-varying noise filter.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein, to generate the excitation signal for the at least one sample of the audio signal using the neural network, the at least one processor is configured to:
generate, using the neural network, an additional excitation signal for a linear time-invariant filter; and
generate, using the linear time-invariant filter based on the additional excitation signal, the excitation signal.

### Claim 13

A method of reconstructing one or more audio signals, the method comprising:
generating, using a neural network, an excitation signal for at least one sample of an audio signal based on one or more inputs to the neural network, the excitation signal being configured to excite a linear predictive coding (LPC) filter; and
generating, using the LPC filter based on the excitation signal, at least one sample of a reconstructed audio signal.

### Claim 14 (depends on 13)

The method of claim 13, wherein the one or more inputs to the neural network include features associated with the audio signal.

### Claim 15 (depends on 14)

The method of claim 14, wherein the features include log-Mel-frequency spectrum features.

### Claim 16 (depends on 13)

The method of claim 13, wherein the LPC filter is a time-varying LPC filter.

### Claim 17 (depends on 13)

The method of claim 13, further comprising:
using filter coefficients of the LPC filter to generate the at least one sample of the reconstructed audio signal.

### Claim 18 (depends on 17)

The method of claim 17, wherein the filter coefficients of the LPC filter are generated based on an autocorrelation of an input audio signal in a voice encoder.

### Claim 19 (depends on 17)

The method of claim 17, further comprising:
deriving the filter coefficients of the LPC filter based on features received from a voice encoder.

### Claim 20 (depends on 19)

The method of claim 19, wherein the features include Mel spectrum features.

### Claim 21 (depends on 13)

The method of claim 13, further comprising:
inputting a pulse train signal based on pitch features to a harmonic filter generated using the neural network;
generating a harmonic filter output;
inputting a random noise signal to a noise filter generated using the neural network;
generating a noise filter output; and
generating the excitation signal at least in part by combining the harmonic filter output with the noise filter output.

### Claim 22 (depends on 13)

The method of claim 13, wherein generating the excitation signal for the at least one sample of the audio signal using the neural network includes:
generating, using the neural network, coefficients for one or more linear time-varying filters; and
generating, using the one or more linear time-varying filters including the generated coefficients, the excitation signal.

### Claim 23 (depends on 22)

The method of claim 22, wherein the one or more linear time-varying filters include a linear time-varying harmonic filter and a linear time-varying noise filter.

### Claim 24 (depends on 13)

The method of claim 13, wherein generating the excitation signal for the at least one sample of the audio signal using the neural network includes:
generating, using the neural network, an additional excitation signal for a linear time-invariant filter; and
generating, using the linear time-invariant filter based on the additional excitation signal, the excitation signal.

### Claim 25

An apparatus for reconstructing one or more audio signals, comprising:
at least one memory configured to store audio data; and
at least one processor coupled to the at least one memory, the at least one processor configured to:
generate, using a linear predictive coding (LPC) filter based on an excitation signal, a predicted signal for at least one sample of an audio signal, the predicted signal being configured to excite a linear time-varying filter;
generate, using a neural network, coefficients for the linear time-varying filter; and
generate, using the linear time-varying filter based on the coefficients, at least one sample of a reconstructed audio signal.

### Claim 26 (depends on 25)

The apparatus of claim 25, wherein one or more inputs to the neural network include features associated with the audio signal.

### Claim 27 (depends on 25)

The apparatus of claim 25, wherein the LPC filter is a time-varying LPC filter.

### Claim 28

A method of reconstructing one or more audio signals, comprising:
generating, using a linear predictive coding (LPC) filter based on an excitation signal, a predicted signal for at least one sample of an audio signal, the predicted signal being configured to excite a linear time-varying filter;
generating, using a neural network, coefficients for the linear time-varying filter; and
generating, using the linear time-varying filter based on the coefficients, at least one sample of a reconstructed audio signal.

### Claim 29 (depends on 28)

The method of claim 28, wherein one or more inputs to the neural network include features associated with the audio signal.

### Claim 30 (depends on 28)

The method of claim 28, wherein the LPC filter is a time-varying LPC filter.
