# US 10,121,468 B2 · System and method for combining geographic metadata in automatic speech recognition language and acoustic models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,121,468 B2
- Document ID: US10121468B2
- Status: Granted
- Kind: B2
- Application number: 15/183,066
- Filed: 2016-06-15
- Published: 2016-10-06
- Granted: 2018-11-06
- Earliest claimed: 2009-12-15
- Assignees: Nuance Communications, Inc.
- Applicants: Nuance Communications, Inc.
- Inventors: Enrico Bocchieri; Diamantino Antonio Caseiro
- Web page: https://patentgrep.com/patent/US10121468B2

## CPC

- G10L 15/08: Speech classification or search
- G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G10L 15/197: Probabilistic grammars, e.g. word n-grams
- G10L 25/54: for retrieval
- G10L 15/19: Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
- G10L 2015/081: {Search algorithms, e.g. Baum-Welch or Viterbi}
- G10L 2015/228: {of application context}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Disclosed herein are systems, methods, and computer-readable storage media for a speech recognition application for directory assistance that is based on a user's spoken search query. The spoken search query is received by a portable device and portable device then determines its present location. Upon determining the location of the portable device, that information is incorporated into a local language model that is used to process the search query. Finally, the portable device outputs the results of the search query based on the local language model.

## Claims

### Claim 1

A method comprising:
incorporating a granularity description of a present location of a device into a local language model, the granularity description using topologically concentric locations to determine probabilities;
combining the local language model with a global language model according to the probabilities, to yield a combined language model; and
outputting, using the combined language model and via a spoken dialog system, audible spoken language results for a spoken query based on the present location and a term in the spoken query.

### Claim 2 (depends on 1)

The method of claim 1, wherein the granularity description uses business density to determine weights.

### Claim 3 (depends on 1)

The method of claim 1, further comprising processing the spoken query using the local language model, to yield the results, wherein the local language model comprises the granularity description.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
incorporating the present location into a local acoustic model used to process the spoken query.

### Claim 5 (depends on 1)

The method of claim 1 wherein the present location of the device is determined using one of a global positioning system, triangulation, and automatic number identification.

### Claim 6 (depends on 1)

The method of claim 1, wherein incorporating of the granularity description into the local language model further comprises:
partitioning training data into geographical areas;
estimating models for each partition; and
selecting a portioned model based on the present location of the device.

### Claim 7 (depends on 6)

The method of claim 6, further comprising generating a user model by combining two models using interpolation.

### Claim 8 (depends on 1)

The method of claim 1, wherein entities in the local language model are related at one of a city, an area code, and a state level.

### Claim 9 (depends on 1)

The method of claim 1, wherein the device is a portable device.

### Claim 10

A spoken dialog system comprising:
a processor; and
a computer-readable storage medium having instructions stored which, when executed by the processor, result in operations comprising:
incorporating a granularity description of a present location of a device into a local language model, the granularity description using topologically concentric locations to determine probabilities;
combining the local language model with a global language model according to the probabilities, to yield a combined language model; and
outputting, using the combined language model, audible spoken language results for a spoken query based on the present location and a term in the spoken query.

### Claim 11 (depends on 10)

The spoken dialog system of claim 10, wherein the device is a portable device.

### Claim 12 (depends on 10)

The spoken dialog system of claim 10, wherein the granularity description uses business density to determine weights.

### Claim 13 (depends on 10)

The spoken dialog system of claim 10, wherein the computer-readable storage medium stores additional instructions stored which, when executed by the processor, cause the processor to perform operations comprising processing the spoken query using the local language model, to yield the results, wherein the local language model comprises the granularity description.

### Claim 14 (depends on 10)

The spoken dialog system of claim 10, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising:
incorporating the present location into a local acoustic model used to process the spoken query.

### Claim 15 (depends on 10)

The spoken dialog system of claim 10, wherein the present location of the device is determined using one of a global positioning system, triangulation, and automatic number identification.

### Claim 16 (depends on 10)

The spoken dialog system of claim 10, wherein incorporating of the granularity description into the local language model further comprises:
partitioning training data into geographical areas;
estimating models for each partition; and
selecting a portioned model based on the location of the device.

### Claim 17 (depends on 16)

The spoken dialog system of claim 16, the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising generating a user model by combining two models using interpolation.

### Claim 18 (depends on 10)

The spoken dialog system of claim 10, wherein entities in the local language model are related at one of a city, an area code, and a state level.

### Claim 19

A computer-readable storage device having instructions stored which, when executed by a computing device, result in operations comprising:
incorporating a granularity description of a present location of a device into a local language model, the granularity description using topologically concentric locations to determine probabilities;
combining the local language model with a global language model according to the probabilities, to yield a combined language model; and
outputting, using the combined language model, audible spoken language results for a spoken query based on the present location and a term in the spoken query.

### Claim 20 (depends on 19)

The computer-readable storage device of claim 19, wherein the granularity description uses topologically concentric locations to determine weights.
