# US 2008/0270133 A1 · Speech model refinement with transcription error detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0270133 A1
- Document ID: US20080270133A1
- Status: Published application
- Kind: A1
- Application number: 11/789,132
- Filed: 2007-04-24
- Published: 2008-10-30
- Earliest claimed: 2007-04-24
- Assignees: Microsoft Corporation
- Inventors: Ye Tian; Yifan Gong; Frank K. Soong
- Web page: https://patentgrep.com/patent/US20080270133A1

## CPC

- G10L 15/065: Adaptation
- G10L 15/01: Assessment or evaluation of speech recognition systems
- G10L 15/08: Speech classification or search
- G10L 2015/0631: {Creating reference templates; Clustering}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Reliable transcription error-checking algorithm that uses a word confidence score and a word duration probability to detect transcription errors for improved results through the automatic detection of transcription errors in a corpus. The transcription error-checking algorithm is combined model training so as to use a current model to detect transcription errors, remove utterances which contain incorrect transcription (or manually fix the found errors), and retrain the model. This process can be repeated for several iterations to obtain an improved speech recognition model. The speech model is employed to achieve speech-transcription alignment to obtain a word boundary. Speech recognizer is then utilized to generate a word-lattice. Using the word boundary and word lattice, error detection is computed using a word confidence score and a word duration probability.

## Claims

### Claim 1

A computer-implemented error checking system, comprising:
a duration component for computing word duration probability data based on a speech model, and a corpus of transcription data and wave data;
a confidence component for computing a confidence score based on recognition processing of the speech model and wave data, and alignment output of the transcription data and the wave data; and
an error component for detecting transcription error based on the duration probability data and the confidence score.

### Claim 2 (depends on 1)

The system of claim 1, further comprising a correction component for removing utterance error from the speech model in a first iteration and feeding back the speech model of the first iteration for retraining of the speech model in a second iteration.

### Claim 3 (depends on 1)

The system of claim 1, further comprising a correction component that facilitates manually checking the transcription error and correcting utterance errors for feedback during retraining of the speech model.

### Claim 4 (depends on 1)

The system of claim 1, further comprising an alignment component that forces alignment of the transcription data, the wave data, and the speech model to generate the word duration probability data.

### Claim 5 (depends on 1)

The system of claim 1, further comprising a recognition component for performing the recognition processing on the wave data and the speech model using a word loop grammar and generating a word lattice graph.

### Claim 6 (depends on 1)

The system of claim 1, further comprising a correction component for using the transcription error to remove from the corpus utterances having errors.

### Claim 7 (depends on 1)

The system of claim 1, wherein the error component facilitates manually checking the transcription error found automatically by an error checking system.

### Claim 8 (depends on 1)

The system of claim 1, wherein the corpus with the transcription error removed is used for retraining the speech model.

### Claim 9 (depends on 1)

The system of claim 1, wherein the confidence score is based on a posterior probability, generalized posterior probability, or a generalized phone posterior probability.

### Claim 10 (depends on 1)

The system of claim 1, further comprising a threshold component for detecting the transcription error based on the word duration probability data relative to a threshold value.

### Claim 11 (depends on 1)

The system of claim 1, further comprising a threshold component for detecting the transcription error based on the confidence score relative to a threshold value.

### Claim 12

A computer-implemented method of error checking, comprising:
computing duration probability data by forcing alignment of a speech model and a corpus of transcription data and wave data;
computing a confidence score based on recognition processing;
detecting errors based on the duration probability data and the confidence score; and
retraining the speech model based on removal of the errors from the corpus.

### Claim 13 (depends on 12)

The method of claim 12, further comprising retraining the corpus based on detection of the errors.

### Claim 14 (depends on 12)

The method of claim 12, further comprising calculating the duration probability data based on a word boundary.

### Claim 15 (depends on 12)

The method of claim 12, further comprising generating a word lattice based on recognition processing of the speech model and the wave data, the word lattice employed to compute the word confidence score.

### Claim 16 (depends on 12)

The method of claim 12, further comprising building a histogram of duration distributions for word models.

### Claim 17 (depends on 16)

The method of claim 16, further comprising selecting outlying duration distributions as having the errors.

### Claim 18 (depends on 12)

The method of claim 12, further comprising modeling the duration probability data according to a Gaussian distribution or a Gamma distribution.

### Claim 19 (depends on 12)

The method of claim 12, further comprising detecting error based on silence confidence scores.

### Claim 20

A computer-implemented system, comprising:
computer-implemented means for computing duration probability data by forcing alignment of a speech model and a corpus of transcription data and wave data;
computer-implemented means for computing a confidence score based on recognition processing;
computer-implemented means for detecting errors based on the duration probability data and the confidence score; and
computer-implemented means for retraining the speech model based on removal of the errors from the corpus.
