# US 2008/0288258 A1 · Method and apparatus for speech analysis and synthesis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0288258 A1
- Document ID: US20080288258A1
- Status: Published application
- Kind: A1
- Application number: 12/061,645
- Filed: 2008-04-03
- Published: 2008-11-20
- Earliest claimed: 2007-04-04
- Assignees: International Business Machines Corporation
- Inventors: Dan Ning Jiang; Fan Ping Meng; Yong Qin; Zhi Wei Shuang
- Web page: https://patentgrep.com/patent/US20080288258A1

## CPC

- G10L 13/04: Details of speech synthesis systems, e.g. synthesiser structure or memory management
- G10L 25/48: specially adapted for particular use
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

The present invention provides a speech analysis method comprising steps of obtaining a speech signal and a corresponding DEGG/EGG signal; regarding the speech signal as the output of a vocal tract filter in a source-filter model taking the DEGG/EGG signal as the input; and estimating the features of the vocal tract filter from the speech signal as the output and the DEGG/EGG signal as the input, wherein the features of the vocal tract filter are expressed by the state vectors of the vocal tract filter at selected time points, and the step of estimating is performed using Kalman filtering.

## Claims

### Claim 1

A speech analysis method, comprising the steps of:
obtaining a speech signal and a corresponding DEGG/EGG signal;
providing the speech signal as the output of a vocal tract filter in a source-filter model taking the DEGG/EGG signal as the input; and
estimating the features of the vocal tract filter from the speech signal as the output and the DEGG/EGG signal as the input.

### Claim 2 (depends on 1)

The speech analysis method according to claim 1, wherein the features of the vocal tract filter are expressed by the state vectors of the vocal tract filter at selected time points, and the step of estimating is performed using Kalman filtering.

### Claim 3 (depends on 2)

The speech analysis method according to claim 2, wherein Kalman filtering is based on:
a state function
xk=xk−1+dk and
an observation function
vk=ekTxk+nk,
wherein, xk=[xk(0), xk(1), . . . , xk(N−1)]T represents the state vector to be estimated of the vocal tract filter at time point k, wherein xk(0), xk(1), . . . , xk(N−1) represent N samples of the expected unit impulse response of the vocal tract filter at time k;
dk=[dk(0), dk(1), . . . , dk(N−1)]T represents the disturbance added to the state vector of the vocal tract filter at time k;
ek=[ek, ek−1, . . . , ek−N+1]T is a vector, of which the element ek represents the DEGG signal inputted at time k;
vk represents the speech signal outputted at time k; and
nk represents the observation noise added to the outputted speech signal at time k.

### Claim 4 (depends on 3)

The speech analysis method according to claim 3, wherein Kalman filtering is a two-way Kalman filtering comprising a forward Kalman filtering and a backward Kalman filtering, wherein,
the forward Kalman filtering comprises the steps of:
forward estimation:
xk˜=xk−1*,
Pk˜=Pk−1+Q
correction:
Kk=Pk˜ek[ekTPk˜ek+r]−1
xk*=xk˜+Kk[vk−ekTxk˜]
Pk=[I−KkekT]Pk˜
forward recursion
k=k+1;
the backward Kalman filtering comprises the steps of:
backward estimation:
xk˜=xk+1*,
Pk˜=Pk+1+Q
correction:
Kk=Pk˜ek[ekTPk˜ek+r]−1
xk*=xk˜+Kk[vk−ekTxk˜]
Pk=[I−KkekT]Pk˜
backward recursion
k=k−1;
wherein, xk˜ represents the estimated state value at time point k, xk* represents the corrected state value at time point k, Pk˜ represents the pre-estimated value of the covariance matrix of the estimation error, Pk represents the corrected value of the covariance matrix of the estimation error, Q represents the covariance matrix of disturbance dk, Kk represents the Kalman gain, r represents the variance of the observation noise nk, I represents the unit matrix; and
the estimation results of the two-way Kalman filtering are the combination of the estimation results of the forward Kalman filtering and those of the backward Kalman filtering using the following formula:
Pk=(Pk+−+Pk−−1)−1,
xk*=Pk(Pk+−1xk+*+Pk−−1xk−*),
wherein, Pk+, xk+ are the estimated state value and the covariance of the estimation obtained by the forward Kalman filtering respectively, and Pk−, xk− represent the estimated state value and the covariance of the estimation obtained by the backward Kalman filtering respectively.

### Claim 5 (depends on 4)

The speech analysis method according to claim 4, further comprising the step of selecting and recording the estimated state values of the vocal tract filter at selected time points obtained by the Kalman filtering, as the features of the vocal tract filter.

### Claim 6

A speech synthesis method, comprising the steps of:
obtaining a DEGG/EGG signal;
obtaining the features of a vocal tract filter by:
obtaining a speech signal and a corresponding DEGG/EGG signal;
providing the speech signal as the output of a vocal tract filter in a source-filter model taking the DEGG/EGG signal as the input; and
estimating the features of the vocal tract filter from the speech signal as the output and the DEGG/EGG signal as the input; and
synthesizing speech based on the DEGG/EGG signal and the obtained features of the vocal tract filter.

### Claim 7 (depends on 6)

The speech synthesis method according to claim 6, wherein the step of obtaining the DEGG/EGG signal comprises:
reconstructing a full DEGG/EGG signal using a DEGG/EGG signal of a single period based on a given fundamental frequency and time length.

### Claim 8

A speech analysis apparatus, comprising:
a module for obtaining a speech signal;
a module for obtaining the corresponding DEGG/EGG signal; and
an estimation module for, by regarding the speech signal as the output of a vocal tract filter in a source-filter model with the DEGG/EGG signal as the input, estimating the features of the vocal tract filter from the speech signal as the output and the DEGG/EGG signal as the input.

### Claim 9 (depends on 8)

The speech analysis apparatus according to claim 8, wherein the estimation module uses the state vectors of the vocal tract filter at selected time points to express the features of the vocal tract filter, and uses the Kalman filtering to perform the estimation

### Claim 10 (depends on 9)

The speech analysis apparatus according to claim 9, wherein the Kalman filtering is based on:
a state function
xk=xk−1+dk, and
an observation function
vk=ekTxk+nk,
wherein, xk=[xk(0), xk(1), . . . , xk(N−1)]T represents the state vector to be estimated of the vocal tract filter at time point k, wherein xk(0), xk(1), . . . , xk(N−1) represent N samples of the expected unit impulse response of the vocal tract filter at time k;
dk=[dk(0), dk(1), . . . , dk(N−1)]T represents the disturbance added to the state vector of the vocal tract filter at time k;
ek=[ek, ek−1, . . . , ek−N+1]T is a vector, of which the element ek represents the DEGG signal inputted at time k;
vk represents the speech signal outputted at time k; and
nk represents the observation noise added to the outputted speech signal at time k.

### Claim 11 (depends on 10)

The speech analysis apparatus according to claim 10, wherein the Kalman filtering is a two-way Kalman filtering comprising a forward Kalman filtering and a backward Kalman filtering, wherein,
the forward Kalman filtering comprises the following steps:
forward estimation:
xk˜=xk−1*,
Pk˜=Pk−1+Q
correction:
Kk=Pk˜ek[ekTPk˜ek+r]−1
xk*=xk˜+Kk[vk−ekTxk˜]
Pk=[I−KkekT]Pk˜
forward recursion
k=k+1;
the backward Kalman filtering comprises the following steps:
backward estimation:
xk˜=xk+1*,
Pk˜=Pk+1+Q
correction:
Kk=Pk˜ek[ekTPk˜ek+r]−1
xk*=xk˜+Kk[vk−ekTxk˜]
Pk=[I−KkekT]Pk˜
backward recursion
k=k−1;
wherein, xk˜ represents the pre-estimated state value at time point k, xk* represents the corrected state value at time point k, Pk˜ represents the pre-estimated value of the covariance matrix of the estimation error, Pk represents the corrected value of the covariance matrix of the estimation error, Q represents the covariance matrix of disturbance dk, Kk represents the Kalman gain, r represents the variance of the observation noise nk, I represents the unit matrix; and
the estimation results of the two-way Kalman filter are the combination of estimation results of the forward Kalman filter and those of the backward Kalman filtering using the following formula:
Pk=(Pk+−1+Pk−−1)−1,
xk*=Pk(Pk+−1xk+*+Pk−−1xk−*),
wherein, Pk+, xk+ are the estimated state value and the covariance of the estimation obtained by the forward Kalman filtering respectively, and Pk−, xk− represent the estimated state value and the covariance of the estimation obtained by the backward Kalman filtering respectively.

### Claim 12 (depends on 11)

The speech analysis apparatus according to claim 11 further comprising a selection and recording module for selecting and recording the estimated state values of the vocal tract filter at selected time points obtained by the Kalman filtering, as the features of the vocal tract filter.

### Claim 13

A speech synthesis apparatus, comprising:
a module for obtaining a DEGG/EGG signal;
the speech analysis apparatus comprising:
a module for obtaining a speech signal;
a module for obtaining the corresponding DEGG/EGG signal; and
an estimation module for, by regarding the speech signal as the output of a vocal tract filter in a source-filter model with the DEGG/EGG signal as the input, estimating the features of the vocal tract filter from the speech signal as the output and the DEGG/EGG signal as the input; and
a speech synthesis module for synthesizing a speech signal based on the DEGG/EGG signal obtained by the module for obtaining a DEGG/EGG signal and the features of the vocal tract filter estimated by the speech analysis apparatus.

### Claim 14 (depends on 13)

The speech synthesis apparatus according to claim 13, wherein the module for obtaining a DEGG/EGG signal is further configured to reconstruct a full DEGG/EGG signal using a DEGG/EGG signal of a single period based on a given fundamental frequency and time length.
