# US 2004/0064314 A1 · Methods and apparatus for speech end-point detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0064314 A1
- Document ID: US20040064314A1
- Status: Published application
- Kind: A1
- Application number: 10/259,131
- Filed: 2002-09-27
- Published: 2004-04-01
- Earliest claimed: 2002-09-27
- Inventors: Nicolas de Saint Aubert; David Kryze
- Web page: https://patentgrep.com/patent/US20040064314A1

## CPC

- G10L 25/87: Detection of discrete points within a voice signal
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

In one aspect, the present invention provides a method for detecting speech end points in an input signal containing speech portions and non-speech (noise) portions. The method includes processing signal frames of a digital input signal containing speech and non-speech portions to extract features from the signal frames, comparing at least one property of the processed signal frames to a noise model and a speech model to determine whether a processed signal frame contains speech or noise, generating a signal indicative of the speech or noise determination, and updating either the speech model or the noise model depending upon whether a processed signal frame is determined to contain speech or noise, respectively. In some configurations, the method also includes resetting the speech and noise models dependent upon whether a number of zero crossings in a determined inter-frame correlation is greater than a threshold number.

## Claims

### Claim 1

A method for detecting speech end points in an input signal containing speech portions and non-speech (noise) portions, said method comprising:
processing signal frames of a digital input signal containing speech and non-speech portions to extract features therefrom;
comparing at least one property of the processed signal frames to a noise model and a speech model to determine whether a processed signal frame contains speech or noise;
generating a signal indicative of the speech or noise determination; and
updating either the speech model or the noise model depending upon whether a processed signal frame is determined to contain speech or noise, respectively.

### Claim 2 (depends on 1)

A method in accordance with claim 1 further comprising:
determining when the comparisons indicate that a selected number of consecutive speech-containing frames have occurred;
determining an inter-frame correlation of the current frame with another previously received frame of the consecutively indicated speech-containing frames; and
resetting the speech and noise models dependent upon whether a number of zero crossings in the determined inter-frame correlation is greater than a threshold number.

### Claim 3 (depends on 1)

A method in accordance with claim 1 further comprising, for a current frame immediately following a determination that the immediately previous frame contained noise:
comparing a signal level of the current frame to one or more sound level thresholds; and
gating said signal indicative of said speech or noise determination upon said signal to sound level threshold comparison.

### Claim 4 (depends on 1)

A method in accordance with claim 1 wherein said noise model is a noise entropy model, and said speech model is a speech entropy model.

### Claim 5 (depends on 4)

A method in accordance with claim 4 further comprising analyzing signal frames to update the noise entropy model and the speech entropy model.

### Claim 6 (depends on 1)

A method in accordance with claim 1 wherein said at least one property of the processed signal frame is entropy of the processed signal frame, and further comprising conditioning said comparing at least one property of the processed signal frames to a noise model and a speech model upon the availability of a speech model, and if a speech model is not available, determining whether a processed signal frame contains speech or noise dependent upon a comparison of the entropy of the current frame against a fixed threshold.

### Claim 7 (depends on 1)

A method in accordance with claim 1 and further comprising whitening a spectrum of the current frame in accordance with a noise spectral model prior to said comparing at least one property of the processed signal frames to a noise model and a speech model.

### Claim 8 (depends on 7)

A method in accordance with claim 7 further comprising analyzing the signal frames to update the noise spectral model.

### Claim 9 (depends on 1)

A method in accordance with claim 1 wherein said processing the signal frames comprises performing a fast Fourier transform.

### Claim 10 (depends on 1)

A method in accordance with claim 1 wherein said processing the signal frames comprises performing a wavelet decomposition.

### Claim 11 (depends on 1)

A method in accordance with claim 1 further comprising utilizing said signal indicative of the speech or noise determination in a speech recognition system to distinguish between speech utterances that are to be ignored from those that are to be translated into text by the speech recognition system.

### Claim 12

A method for detecting speech end points in an input signal containing speech portions and non-speech (noise) portions, said method comprising:
analyzing signal frames of the input signal to generate a noise model if no noise model exists;
when a noise model exists, determining, frame by frame, whether a frame contains speech or noise and generating a signal indicative of whether the frame contains speech or noise; and
when a specified number of consecutive speech frame determinations have been made, resetting a speech model and the noise model dependent upon a comparison of an inter-frame correlation property with at least one selected criterion.

### Claim 13 (depends on 12)

A method in accordance with claim 12 wherein said at least one selected criterion comprises zero crossings of the inter-frame correlation.

### Claim 14 (depends on 12)

A method in accordance with claim 12 further comprising, when a noise model exists, updating, frame by frame, either the speech model or the noise model, depending upon whether a frame has been determined to contain speech or noise, respectively.

### Claim 15 (depends on 14)

A method in accordance with claim 14 wherein said speech model comprises a speech entropy model and wherein said noise model comprises a noise entropy model.

### Claim 16 (depends on 15)

A method in accordance with claim 15 wherein said noise model further comprises a noise spectral model.

### Claim 17 (depends on 16)

A method in accordance with claim 16 wherein said at least one selected criterion comprises zero crossings of the inter-frame correlation.

### Claim 18 (depends on 12)

A method in accordance with claim 12 wherein said determining, frame by frame, whether a frame contains speech or noise further comprises:
determining, frame by frame, whether a sound level is exceeded and either tracking a speaker according to a speaker tracking criterion or applying an energy activation criterion in accordance with said determination of whether a sound level is exceeded, and utilizing said tracking or said applying an energy activation criterion to produce a first gating decision.

### Claim 19 (depends on 18)

A method in accordance with claim 18 further comprising determining, frame by frame, whether a speech model is available, and applying either a Bayesian rule decision utilizing a noise entropy model and a speech entropy model or a fixed threshold decision in accordance with said determination of whether a speech model is available, and to produce a second gating decision utilizing said Bayesian rule decision or said fixed threshold decision.

### Claim 20 (depends on 19)

A method in accordance with claim 19 wherein said determining, frame by frame, whether a frame contains speech or noise further comprises determining both said first gating decision and said second gating decision are indicative of speech being present.

### Claim 21 (depends on 12)

A method in accordance with claim 12 further comprising determining, frame by frame, whether a speech model is available, and applying either a Bayesian rule decision utilizing a noise entropy model and a speech entropy model or a fixed threshold decision in accordance with said determination of whether a speech model is available, said Bayesian rule decision or said fixed threshold decision thereby producing a gating decision.

### Claim 22 (depends on 12)

A method in accordance with claim 12 further comprising utilizing said signal indicative of whether a frame contains speech or noise in a speech recognition system to distinguish between speech utterances that are to be ignored from those that are to be translated into text by the speech recognition system.

### Claim 23

An apparatus for detecting speech end points in an input signal containing speech portions and non-speech (noise) portions, said apparatus configured to:
process signal frames of a digital input signal containing speech and non-speech portions to extract features therefrom;
compare at least one property of the processed signal frames to a noise model and a speech model to determine whether a processed signal frame contains speech or noise;
generate a signal indicative of the speech or noise determination; and
update either the speech model or the noise model depending upon whether a processed signal frame is determined to contain speech or noise, respectively.

### Claim 24 (depends on 23)

An apparatus in accordance with claim 23 further configured to:
determine when the comparisons indicate that a selected number of consecutive speech-containing frames have occurred;
determine an inter-frame correlation of the current frame with another previously received frame of the consecutively indicated speech-containing frames; and
reset the speech and noise models dependent upon whether a number of zero crossings in the determined inter-frame correlation is greater than a threshold number.

### Claim 25 (depends on 23)

An apparatus in accordance with claim 23 further configured to, for a current frame immediately following a determination that the immediately previous frame contained noise:
compare a signal level of the current frame to one or more sound level thresholds; and
gate said signal indicative of said speech or noise determination upon said signal to sound level threshold comparison.

### Claim 26 (depends on 23)

An apparatus in accordance with claim 23 wherein said noise model is a noise entropy model, and said speech model is a speech entropy model.

### Claim 27 (depends on 26)

An apparatus in accordance with claim 26 further configured to analyze signal frames to update the noise entropy model and the speech entropy model.

### Claim 28 (depends on 23)

An apparatus in accordance with claim 23 wherein said at least one property of the processed signal frame is entropy of the processed signal frame, and wherein said apparatus is further configured to condition said comparing at least one property of the processed signal frames to a noise model and a speech model upon the availability of a speech model, and if a speech model is not available, said apparatus is configured to determine whether a processed signal frame contains speech or noise dependent upon a comparison of the entropy of the current frame against a fixed threshold.

### Claim 29 (depends on 23)

An apparatus in accordance with claim 23 further configured to whiten a spectrum of the current frame in accordance with a noise spectral model prior to said comparing at least one property of the processed signal frames to a noise model and a speech model.

### Claim 30 (depends on 29)

An apparatus in accordance with claim 29 further configured to analyze the signal frames to update the noise spectral model.

### Claim 31 (depends on 23)

An apparatus in accordance with claim 23 wherein to process the signal frames, said apparatus is configured to perform a fast Fourier transform.

### Claim 32 (depends on 23)

An apparatus in accordance with claim 23 wherein to process the signal frames, said apparatus is configured to perform a wavelet decomposition.

### Claim 33 (depends on 23)

An apparatus in accordance with claim 23 further comprising a speech recognition system, and wherein said apparatus is configured to utilize said signal indicative of the speech or noise determination to distinguish between speech utterances that are to be ignored from those that are to be translated into text by the speech recognition system.

### Claim 34

An apparatus for detecting speech end points in an input signal containing speech portions and non-speech (noise) portions, said apparatus configured to:
analyze signal frames of the input signal to generate a noise model if no noise model exists;
when a noise model exists, determine, frame by frame, whether a frame contains speech or noise and generate a signal indicative of whether the frame contains speech or noise; and
when a specified number of consecutive speech frame determinations have been made, reset a speech model and the noise model dependent upon a comparison of an inter-frame correlation property with at least one selected criterion.

### Claim 35 (depends on 34)

An apparatus in accordance with claim 34 wherein said at least one selected criterion comprises zero crossings of the inter-frame correlation.

### Claim 36 (depends on 34)

An apparatus in accordance with claim 34 further configured, when a noise model exists, to update, frame by frame, either the speech model or the noise model, depending upon whether a frame has been determined to contain speech or noise, respectively.

### Claim 37 (depends on 36)

An apparatus in accordance with claim 36 wherein said speech model comprises a speech entropy model and wherein said noise model comprises a noise entropy model.

### Claim 38 (depends on 37)

An apparatus in accordance with claim 37 wherein said noise model further comprises a noise spectral model.

### Claim 39 (depends on 38)

An apparatus in accordance with claim 38 wherein said at least one selected criterion comprises zero crossings of the inter-frame correlation.

### Claim 40 (depends on 34)

An apparatus in accordance with claim 34 wherein to determine, frame by frame, whether a frame contains speech or noise, said apparatus is further configured to: determine, frame by frame, whether a sound level is exceeded and to either track a speaker according to a speaker tracking criterion or apply an energy activation criterion in accordance with said determination of whether a sound level is exceeded, and to produce a first gating decision utilizing said tracking or said applying an energy activation criterion.

### Claim 41 (depends on 40)

An apparatus in accordance with claim 40 further configured to determine, frame by frame, whether a speech model is available, to apply either a Bayesian rule decision utilizing a noise entropy model and a speech entropy model or a fixed threshold decision in accordance with said determination of whether a speech model is available, and to produce a second gating decision utilizing said Bayesian rule decision or said fixed threshold decision.

### Claim 42 (depends on 41)

An apparatus in accordance with claim 41 wherein said apparatus is configured to determine, frame by frame, whether a frame contains speech or noise only when both said first gating decision and said second gating decision are indicative of speech being present.

### Claim 43 (depends on 34)

An apparatus in accordance with claim 34 wherein to determine, frame by frame, whether a speech model is available, said apparatus is further configured to apply either a Bayesian rule decision utilizing a noise entropy model and a speech entropy model or a fixed threshold decision in accordance with said determination of whether a speech model is available, and to produce a gating decision utilizing said Bayesian rule decision or said fixed threshold decision.

### Claim 44 (depends on 34)

An apparatus in accordance with claim 34 further comprising a speech recognition system, wherein said apparatus is further configured to utilize said signal indicative of whether a frame contains speech or noise to distinguish between speech utterances that are to be ignored from those that are to be translated into text by the speech recognition system.

### Claim 45

A machine readable medium having recorded thereon instructions configured to instruct a processor to detect speech end points in an input signal containing speech portions and non-speech (noise) portions, said instructions configured to instruct the processor to:
process signal frames of a digital input signal containing speech and non-speech portions to extract features therefrom;
compare at least one property of the processed signal frames to a noise model and a speech model to determine whether a processed signal frame contains speech or noise;
generate a signal indicative of the speech or noise determination; and
update either the speech model or the noise model depending upon whether a processed signal frame is determined to contain speech or noise, respectively.

### Claim 46 (depends on 45)

A medium in accordance with claim 45 wherein said machine readable instructions are further configured to instruct the processor to:
determine when the comparisons indicate that a selected number of consecutive speech-containing frames have occurred;
determine an inter-frame correlation of the current frame with another previously received frame of the consecutively indicated speech-containing frames; and
reset the speech and noise models dependent upon whether a number of zero crossings in the determined inter-frame correlation is greater than a threshold number.

### Claim 47 (depends on 45)

A medium in accordance with claim 45 wherein said machine readable instructions are further configured to instruct the processor, for a current frame immediately following a determination that the immediately previous frame contained noise, to:
compare a signal level of the current frame to one or more sound level thresholds; and
gate said signal indicative of said speech or noise determination upon said signal to sound level threshold comparison.

### Claim 48 (depends on 45)

A medium in accordance with claim 45 wherein said noise model is a noise entropy model, and said speech model is a speech entropy model.

### Claim 49 (depends on 48)

A medium in accordance with claim 48 wherein said instructions are further configured to instruct the processor to analyze signal frames to update the noise entropy model and the speech entropy model.

### Claim 50 (depends on 45)

A medium in accordance with claim 45 wherein said at least one property of the processed signal frame is entropy of the processed signal frame, and wherein said instructions are further configured to instruct the processor to condition said comparing at least one property of the processed signal frames to a noise model and a speech model upon the availability of a speech model, and if a speech model is not available, said instructions are further configured to instruct the processor to determine whether a processed signal frame contains speech or noise dependent upon a comparison of the entropy of the current frame against a fixed threshold.

### Claim 51 (depends on 45)

A medium in accordance with claim 45 wherein said instructions are further configured to instruct the processor to whiten a spectrum of the current frame in accordance with a noise spectral model prior to said comparing at least one property of the processed signal frames to a noise model and a speech model.

### Claim 52 (depends on 51)

A medium in accordance with claim 51 wherein said instructions are further configured to instruct the processor to analyze the signal frames to update the noise spectral model.

### Claim 53 (depends on 45)

A medium in accordance with claim 45 wherein to instruct the processor to process the signal frames, said instructions are configured to instruct the processor to perform a fast Fourier transform.

### Claim 54 (depends on 45)

A medium in accordance with claim 45 wherein to instruct the processor to process the signal frames, said instructions are configured to instruct the processor to perform a wavelet decomposition.

### Claim 55 (depends on 45)

A medium in accordance with claim 45 wherein said instructions are configured to instruct a speech recognition system to utilize said signal indicative of the speech or noise determination to distinguish between speech utterances that are to be ignored from those that are to be translated into text by the speech recognition system.

### Claim 56

A machine readable medium having recorded thereon instructions configured to instruct a processor to detect speech end points in an input signal containing speech portions and non-speech (noise) portions, said instructions configured to instruct the processor to:
analyze signal frames of the input signal to generate a noise model if no noise model exists;
when a noise model exists, determine, frame by frame, whether a frame contains speech or noise and generate a signal indicative of whether the frame contains speech or noise; and
when a specified number of consecutive speech frame determinations have been made, reset a speech model and the noise model dependent upon a comparison of an inter-frame correlation property with at least one selected criterion.

### Claim 57 (depends on 56)

A medium in accordance with claim 56 wherein said at least one selected criterion comprises zero crossings of the inter-frame correlation.

### Claim 58 (depends on 56)

A medium in accordance with claim 56 wherein said instructions are further configured to instruct the processor, when a noise model exists, to update, frame by frame, either the speech model or the noise model, depending upon whether a frame has been determined to contain speech or noise, respectively.

### Claim 59 (depends on 58)

A medium in accordance with claim 58 wherein said speech model comprises a speech entropy model and wherein said noise model comprises a noise entropy model.

### Claim 60 (depends on 59)

A medium in accordance with claim 59 wherein said noise model further comprises a noise spectral model.

### Claim 61 (depends on 60)

A medium in accordance with claim 60 wherein said at least one selected criterion comprises zero crossings of the inter-frame correlation.

### Claim 62 (depends on 56)

A medium in accordance with claim 56 wherein to instruct the processor to determine, frame by frame, whether a frame contains speech or noise, said instructions are further configured to instruct the processor to:
determine, frame by frame, whether a sound level is exceeded and to either track a speaker according to a speaker tracking criterion or apply an energy activation criterion in accordance with said determination of whether a sound level is exceeded, and to produce a first gating decision utilizing said tracking or said applying an energy activation criterion.

### Claim 63 (depends on 62)

A medium in accordance with claim 62 wherein said instructions are further configured to instruct the processor to determine, frame by frame, whether a speech model is available, to apply either a Bayesian rule decision utilizing a noise entropy model and a speech entropy model or a fixed threshold decision in accordance with said determination of whether a speech model is available, and to produce a second gating decision utilizing said Bayesian rule decision or said fixed threshold decision.

### Claim 64 (depends on 63)

A medium in accordance with claim 63 wherein said instructions are configured to instruct the processor to determine, frame by frame, whether a frame contains speech or noise only when both said first gating decision and said second gating decision are indicative of speech being present.

### Claim 65 (depends on 56)

A medium in accordance with claim 56 wherein to determine, frame by frame, whether a speech model is available, said instructions are further configured to instruct the processor to apply either a Bayesian rule decision utilizing a noise entropy model and a speech entropy model or a fixed threshold decision in accordance with said determination of whether a speech model is available, and to produce a gating decision utilizing said Bayesian rule decision or said fixed threshold decision.

### Claim 66 (depends on 56)

A medium in accordance with claim 56 wherein said instructions are further configured to instruct the processor to utilize said signal indicative of whether a frame contains speech or noise to distinguish between speech utterances that are to be ignored from those that are to be translated into text by the speech recognition system.
