# US 2004/0083090 A1 · Manager for integrating language technology components

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0083090 A1
- Document ID: US20040083090A1
- Status: Published application
- Kind: A1
- Application number: 10/685,403
- Filed: 2003-10-16
- Published: 2004-04-29
- Earliest claimed: 2002-10-17
- Inventors: Daniel Kiecza; Francis G. Kubala; Peter G. Allen
- Web page: https://patentgrep.com/patent/US20040083090A1

## CPC

- G10L 15/28: Constructional details of speech recognition systems
- G10L 15/32: Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A speech system includes a Language Component Manager (LCM) [116] that functions as middleware between language and technology components [117] and a high-level application [115]. In aggregate, the LCM, the language and technology component, and the high-level application form a speech system. The components of the speech system may be distributed. All data and messages in the speech system pass through the LCM. A configuration file defines relationships, such as message and data paths, for the speech system.

## Claims

### Claim 1

A method for interacting among a plurality of components of a speech system, the plurality of components including language technology components, a middleware component, and at least one high-level application component, the method comprising:
receiving substantially all data communications in the speech system at the middleware component;
forwarding the data communications from the middleware component to a destination one of the language technology components and the high-level application component, as determined by a configuration file;
receiving substantially all message communications in the speech system at the middleware component; and
forwarding the message communications from the middleware component to at least one of the language technology components and the high-level application component, as determined by the configuration file.

### Claim 2 (depends on 1)

The method of claim 1, wherein the speech and language technology components include at least one of a speech recognizer component, a speaker identification component, a topic detection component, and a name extraction component.

### Claim 3 (depends on 1)

The method of claim 1, wherein the language technology components, the middleware component, and the at least one high-level application component are software modules that arc distributed over a plurality of computing devices.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
logging errors encountered by the language technology components at the middleware component.

### Claim 5 (depends on 1)

The method of claim 1, wherein the middleware component presents a single system state to the high-level application component, the single system state being based on individual states of the language technology components.

### Claim 6 (depends on 5)

The method of claim 5, wherein the single system state is selected from:
a starting up state that indicates that at least one of the language technology components is initializing,
a down state that indicates that at least one of the language technology components is not available, and
an up state that indicates that all of the language technology components are available.

### Claim 7 (depends on 6)

The method of claim 6, wherein the single system state is further selected from:
an aborting state that indicates that the middleware component is disconnecting from the high-level application component, and
a shutting down state in which the middleware component discontinues communications with the language technology components.

### Claim 8 (depends on 1)

The method of claim 1, wherein the configuration file is an extensible markup language (XML) document.

### Claim 9 (depends on 1)

The method of claim 1, wherein the data communications are implemented as data pipes.

### Claim 10

A speech system comprising:
a high-level application component;
a plurality of language technology components;
at least one configuration file that describes communication paths among the high-level application component and the plurality of language technology components; and
a language component manager (LCM) configured to act as an intermediary for communications between the high-level application component and the language technology components and between ones of the language technology components, the LCM connecting the high-level application component and the language technology components based on the configuration file.

### Claim 11 (depends on 10)

The speech system of claim 10, wherein the configuration file is a complete system specification for the speech system.

### Claim 12 (depends on 10)

The speech system of claim 10, wherein the high-level application component provides speech services to end-users.

### Claim 13 (depends on 10)

The speech system of claim 10, wherein the LCM presents a single interface to the high-level application component.

### Claim 14 (depends on 10)

The speech system of claim 10, wherein the speech system performs speech recognition.

### Claim 15 (depends on 10)

The speech system of claim 10, wherein the language technology components include at least one of a speech recognizer component, a speaker identification component, a topic detection component, and a name extraction component.

### Claim 16 (depends on 10)

The speech system of claim 10, wherein the language technology components, the LCM, and the high-level application component are software modules that are distributed over a plurality of computing devices.

### Claim 17 (depends on 10)

The speech system of claim 10, wherein the LCM presents a single system state to the high-level application component, the single system state being based on individual states of the language technology components.

### Claim 18 (depends on 17)

The speech system of claim 17, wherein the single system state is selected from:
a starting up state that indicates that at least one of the language technology components is initializing,
a down state that indicates that at least one of the language technology components are not available, and
an up state that indicates the speech system is available.

### Claim 19 (depends on 10)

The speech system of claim 10, wherein the configuration file is an extensible markup language (XML) document.

### Claim 20

A system integration device comprising:
ports configured to connect with a plurality of components configured to perform speech and language processing functions;
at least one port configured to connect with a high-level application designed to implement a speech service using the functions provided by the components; and
a configuration file that includes routing information that describes communication paths among the high-level application and the plurality of first components, communications between the first components and between the first components and the high-level application being routed through the system integration device based on the routing information in the configuration file.

### Claim 21 (depends on 20)

The device of claim 20, wherein the configuration file is a complete system specification for a speech system.

### Claim 22 (depends on 20)

The device of claim 20, wherein the high-level application provides speech services to end-users.

### Claim 23 (depends on 20)

The device of claim 20, wherein the components include at least one of a speech recognizer component, a speaker identification component, a topic detection component, and a name extraction component.

### Claim 24 (depends on 20)

The device of claim 20, wherein the system integration device presents a single system state to the high-level application, the single system state being based on individual states of the components.

### Claim 25 (depends on 24)

The device of claim 24, wherein the single system state is selected from:
a starting up state that indicates that at least one of the components is initializing,
a down state that indicates that at least one of the components is not available, and
an up state that indicates the plurality of components are available.

### Claim 26 (depends on 20)

The device of claim 20, wherein the configuration file is an extensible markup language (XML) document.

### Claim 27

A device for interacting among a plurality of components of a speech system, the plurality of components including one or more language technology components and at least one high-level application component, the device comprising:
means for describing message and data connections between the one or more language technology components and the at least one high-level application component;
means for receiving substantially all data communications in the speech system from the one or more language technology components and the at least one high-level application component;
means for forwarding the received data communications to a designated one of the one or more language technology components and the at least one high-level application component based on the means for describing;
means for receiving substantially all message communications in the speech system from the one or more language technology components and the at least one high-level application component; and
means for forwarding the message communications to at least one of the one or more language technology components and the at least one high-level application component based on the means for describing.

### Claim 28

A computer-readable medium containing programming instructions for execution by a processor, the computer-readable medium comprising:
instructions for causing the processor to connect with a plurality of components configured to perform speech and language processing functions;
instructions for causing the processor to connect with a high-level application designed to implement a speech service using the functions provided by the components; and
instructions that define a configuration file that includes routing information that describes communication paths among the high-level application and the plurality of components, the communications between the components and between the components and the high-level application being routed through the processor based on the routing information in the configuration file.

### Claim 29 (depends on 28)

The computer-readable medium of claim 28, wherein the configuration file is a complete system specification for a speech system.
