# US 2019/0378528 A1 · Apparatus and method for synthesizing an audio signal, decoder, encoder, system and computer program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378528 A1
- Document ID: US20190378528A1
- Status: Published application
- Kind: A1
- Application number: 16/549,878
- Filed: 2019-08-23
- Published: 2019-12-12
- Earliest claimed: 2013-01-29
- Assignees: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Applicants: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Inventors: Guillaume FUCHS; Tom BAECKSTROEM; Ralf GEIGER; Wolfgang JAEGERS; Emmanuel RAVELLI
- Web page: https://patentgrep.com/patent/US20190378528A1

## CPC

- G10L 19/087: using mixed excitation models, e.g. MELP, MBE, split band LPC or HVXC
- G10L 19/02: using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L 19/12: the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
- G10L 19/26: Pre-filtering or post-filtering
- G10L 19/06: Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method and an apparatus for synthesizing an audio signal are described. A spectral tilt is applied to the code of a codebook used for synthesizing a current frame of the audio signal. The spectral tilt is based on the spectral tilt of the current frame of the audio signal. Further, an audio decoder operating in accordance with the inventive approach is described.

## Claims

### Claim 1

An apparatus for synthesizing an audio signal, comprising:
a processing unit configured to apply a spectral tilt to the code of a codebook used for synthesizing a current frame of the audio signal,
wherein the spectral tilt is based on the spectral tilt of the current frame of the audio signal.

### Claim 2 (depends on 1)

The apparatus of claim 1, configured to determine the spectral tilt of the current frame of the audio signal on the basis of spectral envelope information for the current frame of the audio signal.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the spectral envelope information is defined by LPC coefficients, and wherein the spectral tilt of the current frame of the audio signal is defined as follows:
γ
=
-
∑
n
=
0
N

f
s

(
n
+
1
)

f
s

(
n
)
f
s
2

(
n
)
with:
fs(n) the infinite impulse response of a LPC synthesis filter comprising the transfer function Fs(z)=1/A (z), and
N the size of the truncation of the infinite impulse response fs(n).

### Claim 4 (depends on 2)

The apparatus of claim 2, wherein the spectral envelope information is defined by LPC coefficients, and wherein the spectral tilt of the current frame of the audio signal is defined as follows:
γ
=
-
∑
n
=
0
N

f
e

(
n
+
1
)

f
e

(
n
)
f
e
2

(
n
)
with:
fe(n) the infinite impulse response of a LPC synthesis filter comprising the transfer function
F
e

(
z
)
=
A

(
1
/
w


1
)
A

(
1
/
w


2
)
,
N the size of the truncation of the infinite impulse response fs(n), and
w1, w2 weighting constants for defining the formantic structure of the transfer function Fe(z).

### Claim 5 (depends on 3)

The apparatus of claim 3, wherein N is equal to the number of codes in the codebook.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the processing unit is configured to apply the spectral tilt by filtering the code from the codebook based on a transfer function comprising the spectral tilt.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the transfer function comprising the spectral tilt is defined as follows:
Ft1(z)=1−γz−1.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the processing unit is further configured to combine the determined spectral tilt of the current frame of the audio signal with a factor related to the voicing of the previous frame of the audio signal.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the factor related to the voicing of the previous frame of the audio signal is defined as follows:
β
=

constant
·
(
1
+
voicing
)
with

:
voicing
=
energy

(
contribution


of


adapti


ve


codebook
)
-
energy

(
contribution


of


fixed


codebook
)
energy

(
sum


of


contributions
)
.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein the processing unit is configured to apply the spectral tilt by filtering the code from the codebook based on a transfer function comprising the spectral tilt and the factor related to the voicing of the previous frame of the audio signal.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the transfer function comprising the spectral tilt is defined as follows:
Ft2(z)=1−(α·β+b−γ)z−1,
with:
a, b constants.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein the audio signal is a speech signal, wherein the processing unit for applying the spectral tilt comprises a filter, and wherein the apparatus further comprises:
an adaptive codebook,
a fixed codebook,
the filter coupled to the fixed codebook, the filter being configured to apply the determined spectral tilt to the code of the fixed codebook for acquiring a filtered code of the fixed codebook,
a summer coupled to the adaptive codebook and to the filter, the summer configured to combine a code from the adaptive codebook and the filtered code of the fixed codebook for acquiring a combined code, and
a LPC synthesis filter coupled to the summer.

### Claim 13 (depends on 12)

The apparatus of claim 12, further comprising:
a pitch gain amplifier coupled between the adaptive codebook and the summer, the pitch gain amplifier configured to multiply the code from the adaptive codebook with a pitch gain, and
a code gain amplifier coupled between the filter and the summer, the code gain amplifier configured to multiply the filtered code of the fixed codebook with a code gain.

### Claim 14 (depends on 12)

The apparatus of claim 12, further comprising:
a voicing estimator coupled to the adaptive codebook and to the summer, the voicing estimator configured to output a factor related to the voicing of the previous frame of the audio signal to the filter, and
a storage configured to store LPC coefficients describing spectral envelope information for the current frame of the audio signal, the storage being coupled to the filter.

### Claim 15

An audio decoder comprising an apparatus for synthesizing an audio signal, said apparatus comprising:
a processing unit configured to apply a spectral tilt to the code of a codebook used for synthesizing a current frame of the audio signal,
wherein the spectral tilt is based on the spectral tilt of the current frame of the audio signal.

### Claim 16

An audio decoder for decoding an audio signal, wherein the audio decoder is configured to apply a spectral tilt to the code of a codebook used for synthesizing a current frame of the audio signal, wherein the spectral tilt is based on the spectral tilt of the current frame of the audio signal.

### Claim 17

An audio encoder for encoding an audio signal, wherein the audio encoder is configured to determine from a spectral tilt of a current frame of the audio signal a spectral tilt for a code of a codebook representing a current frame of the audio signal.

### Claim 18

A system, comprising:
an audio decoder comprising an apparatus for synthesizing an audio signal, said apparatus comprising:
a processing unit configured to apply a spectral tilt to the code of a codebook used for synthesizing a current frame of the audio signal,
wherein the spectral tilt is based on the spectral tilt of the current frame of the audio signal, and
an audio encoder for encoding an audio signal, wherein the audio encoder is configured to determine from a spectral tilt of a current frame of the audio signal a spectral tilt for a code of a codebook representing a current frame of the audio signal.

### Claim 19

A method for synthesizing an audio signal, the method comprising:
applying a spectral tilt to the code of a codebook used for synthesizing a current frame of the audio signal,
wherein the spectral tilt is determined on the basis of the spectral tilt of the current frame of the audio signal.

### Claim 20 (depends on 19)

The method of claim 19, wherein the spectral tilt of the current frame of the audio signal is determined on the basis of spectral envelope information for the current frame of the audio signal.

### Claim 21 (depends on 20)

The method of claim 20, wherein the spectral envelope information is defined by LPC coefficients, and wherein the spectral tilt of the current frame of the audio signal is determined as follows:
γ
=
-
∑
n
=
0
N

f
s

(
n
+
1
)

f
s

(
n
)
f
s
2

(
n
)
with:
fs(n) the infinite impulse response of a LPC synthesis filter comprising the transfer function Fs(z)=1/A (z), and
N the size of the truncation of the infinite impulse response fs(n).

### Claim 22 (depends on 20)

The method of claim 20, wherein the spectral envelope information is defined by LPC coefficients, and wherein the spectral tilt of the current frame of the audio signal is determined as follows:
γ
=
-
∑
n
=
0
N

f
e

(
n
+
1
)

f
e

(
n
)
f
e
2

(
n
)
with:
fe(n) the infinite impulse response of a LPC synthesis filter comprising the transfer function
F
e

(
z
)
=
A

(
1
/
w


1
)
A

(
1
/
w


2
)
,
N the size of the truncation of the infinite impulse response fs(n), and
w1, w2 weighting constants for defining the formantic structure of the transfer function Fe(z).

### Claim 23 (depends on 21)

The method of claim 21, wherein N is equal to the number of codes in the codebook.

### Claim 24 (depends on 19)

The method of claim 19, wherein applying the spectral tilt comprises filtering the code from the codebook based on a transfer function comprising the spectral tilt.

### Claim 25 (depends on 24)

The method of claim 24, wherein the transfer function comprising the spectral tilt is determined as follows:
Ft1(z)=1−γz−1.

### Claim 26 (depends on 19)

The method of claim 19, further comprising combining the determined spectral tilt of the current frame of the audio signal with a factor related to the voicing of the previous frame of the audio signal.

### Claim 27 (depends on 26)

The method of claim 26, wherein the factor related to the voicing of the previous frame of the audio signal is determined as follows:
β
=

constant
·
(
1
+
voicing
)
with

:
voicing
=
energy

(
contribution


of


adapti


ve


codebook
)
-
energy

(
contribution


of


fixed


codebook
)
energy

(
sum


of


contributions
)
.

### Claim 28 (depends on 26)

The method of claim 26, wherein applying the spectral tilt comprises filtering the code from the codebook based on a transfer function comprising the spectral tilt and the factor related to the voicing of the previous frame of the audio signal.

### Claim 29 (depends on 28)

The method of claim 28, wherein the transfer function comprising the spectral tilt is determined as follows:
Ft2(z)=1−(α·β+b−γ)z−1,
with:
a, b constants.

### Claim 30 (depends on 19)

The method of claim 19, wherein the audio signal is a speech signal, and wherein synthesizing the audio signal comprises for a frame of the audio signal:
applying the determined spectral tilt to the code of a fixed codebook for acquiring a filtered code of the fixed codebook,
combining a code from an adaptive codebook and the filtered code of the fixed codebook to acquire a combined code, and
filtering the combined code by a LPC synthesis filter.

### Claim 31 (depends on 30)

The method of claim 30, further comprising multiplying the code from the adaptive codebook with a pitch gain, and multiplying the filtered code of the fixed codebook with a code gain.

### Claim 32 (depends on 30)

The method of claim 30, further comprising:
based on the code from the adaptive codebook and the combined code, generating a factor related to the voicing of the previous frame of the audio signal, and
storing LPC coefficients describing spectral envelope information for the current frame of the audio signal.

### Claim 33

A non-transitory digital storage medium having a computer program stored thereon to perform a method for synthesizing an audio signal, which method comprises:
applying a spectral tilt to the code of a codebook used for synthesizing a current frame of the audio signal,
wherein the spectral tilt is determined on the basis of the spectral tilt of the current frame of the audio signal,
when said computer program is run by a computer.
