# US 2008/0189106 A1 · Multi-Stage Speech Recognition System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0189106 A1
- Document ID: US20080189106A1
- Status: Published application
- Kind: A1
- Application number: 11/957,883
- Filed: 2007-12-17
- Published: 2008-08-07
- Earliest claimed: 2006-12-21
- Inventors: Andreas Low; Joachim Grill
- Web page: https://patentgrep.com/patent/US20080189106A1

## CPC

- G01C 21/3608: {using speech input, e.g. using speech recognition}
- G10L 15/183: using context dependencies, e.g. language models
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A multi-stage speech recognition system includes an audio transducer that detects a speech signal, and a sampling circuit that converts the transducer output into a digital speech signal. A spectral analysis circuit identifies a portion of the speech signal corresponding to a first class and a second class. The system includes memory storage or a database having a first and a second vocabulary list. A recognition circuit recognizes the first class based on the first vocabulary list to obtain a first recognition result. A matching circuit restricts a vocabulary list based on the first recognition result, and a recognizing circuit recognizes the second class based on the restricted vocabulary list, to obtain a second recognition result.

## Claims

### Claim 1

A multi-stage recognition method for recognizing a speech signal containing semantic information of two or more classes, comprising:
detecting and digitizing the speech signal;
providing a database having at least one vocabulary list for each class;
recognizing a portion of the speech signal corresponding to a first class based on a vocabulary list corresponding to the first class, to obtain a first recognition result;
restricting a vocabulary list corresponding to a second class based on the first recognition result; and
recognizing a portion of the speech signal corresponding to the second class based upon the restricted vocabulary list, to obtain a second recognition result.

### Claim 2 (depends on 1)

The method of claim 1, where the vocabulary list corresponding to the first class contains fewer entries than the vocabulary list corresponding to the second class.

### Claim 3 (depends on 1)

The method of claim 1, where the semantic information of the first class is detected later than the semantic information of the second class.

### Claim 4 (depends on 1)

The method of claim 1, where recognition for each class and restricting the respective vocabulary lists are performed for all of the classes in the speech signal.

### Claim 5 (depends on 1)

The method of claim 1, where recognizing the portion of the speech signal corresponding to the first class and/or second class comprises generating an “N” best list of recognition candidates selected from the respective vocabulary lists.

### Claim 6 (depends on 5)

The method of claim 5, where generating the “N” best list comprises assigning a score to each entry of the respective vocabulary lists.

### Claim 7 (depends on 6)

The method of claim 6, where the score is assigned based on a predetermined probability of mistaking one entry for another entry.

### Claim 8 (depends on 6)

The method of claim 6, where the scores are determined based on an acoustic model probability.

### Claim 9 (depends on 6)

The method of claim 6, where the scores are determined based on a Hidden Markov Model.

### Claim 10 (depends on 6)

The method of claim 6, where the scores are determined based on a grammar model probability.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
dividing the speech signal into a plurality of frames; and
determining at least one characterizing vector for each frame.

### Claim 12 (depends on 11)

The method of claim 11, where the characterizing vector comprises a spectral content of the speech signal.

### Claim 13 (depends on 11)

The method of claim 11, where the characterizing vector comprises a cepstral vector.

### Claim 14 (depends on 1)

The method of claim 1, where the first class corresponds to a city name and the first recognition result identifies the city name; and
the second class corresponds to a street name and the second recognition result identifies the street name.

### Claim 15 (depends on 1)

The method of claim 1, where
a) the first class corresponds to an artist name and the first recognition result identifies the artist name; and
b) the second class corresponds to a song title and the second recognition result identifies the song title.

### Claim 16 (depends on 1)

The method of claim 1, where
a) the first class corresponds to a name of a person and the first recognition result identifies the name of a person; and
b) the second class corresponds to an address or telephone number and the second recognition result identifies the address or telephone number.

### Claim 17

A computer-readable storage medium having processor executable instructions to perform multi-stage recognition of a speech signal containing semantic information of two or more classes, by performing the acts of:
detecting and digitizing the speech signal;
providing a database having at least one vocabulary list for each class;
recognizing a portion of the speech signal corresponding to a first class based on a vocabulary list corresponding to the first class, to obtain a first recognition result;
restricting a vocabulary list corresponding to a second class based on the first recognition result; and
recognizing a portion of the speech signal corresponding to the second class based upon the restricted vocabulary list, to obtain a second recognition result.

### Claim 18 (depends on 17)

The computer-readable storage medium of claim 17, further comprising processor executable instructions to cause a processor to perform the act of detecting the semantic information of the first class later than detecting the semantic information of the second class.

### Claim 19 (depends on 17)

The computer-readable storage medium of claim 17, further comprising processor executable instructions to cause a processor to perform the acts of recognizing each class and restricting the respective vocabulary lists for all of the classes in the speech signal.

### Claim 20 (depends on 17)

The computer-readable storage medium of claim 17, further comprising processor executable instructions to cause a processor to perform the acts of generating an “N” best list of recognition candidates selected from the respective vocabulary lists.

### Claim 21

A system for multi-stage speech recognition, comprising:
an audio transducer configured to detect a speech signal;
a sampling circuit configured to digitize the detected speech signal;
a database configured to store at least a first and a second vocabulary list;
a spectral analysis circuit configured to identify a portion of the speech signal corresponding to a first class and a second class;
a recognition circuit configured to recognize the first class based on the first vocabulary list to obtain a first recognition result;
a matching circuit configured to restrict at least one vocabulary list other than the first vocabulary list, based on the first recognition result; and
the recognizing circuit configured to recognize the second class based on the restricted vocabulary list, to obtain a second recognition result.

### Claim 22 (depends on 21)

The system of claim 21, further comprising:
a navigation system;
an application control circuit configured to control the navigation system; and where the application control circuit receives commands based on the first and second recognition results and controls the navigation system based on the received commands.

### Claim 23 (depends on 21)

The system of claim 21 further comprising:
a media system;
an application control circuit configured to control the media system; and where the application control circuit receives commands based on the first and second recognition results and controls the media system based on the received commands.

### Claim 24 (depends on 21)

The system of claim 21, further comprising:
a user-controlled device;
an application control circuit configured to control the user-controlled device; and where
the application control circuit receives commands based on the first and second recognition results and controls the user-controlled device based on the received commands.
