# US 2018/0025722 A1 · System and method for enhancing speech recognition accuracy using weighted grammars based on user profile including demographic, account, time and date information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025722 A1
- Document ID: US20180025722A1
- Status: Published application
- Kind: A1
- Application number: 15/679,232
- Filed: 2017-08-17
- Published: 2018-01-25
- Earliest claimed: 2008-12-19
- Assignees: Nuance Communications, Inc.
- Applicants: Nuance Communications, Inc.
- Inventors: Michael CZAHOR
- Web page: https://patentgrep.com/patent/US20180025722A1

## CPC

- G10L 15/19: Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
- G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G10L 2015/227: {of the speaker; Human-factor methodology}
- G10L 2015/228: {of application context}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Disclosed herein are systems, computer-implemented methods, and computer-readable media for enhancing speech recognition accuracy. The method includes dividing a system dialog turn into segments based on timing of probable user responses, generating a weighted grammar for each segment, exclusively activating the weighted grammar generated for a current segment of the dialog turn during the current segment of the dialog turn, and recognizing user speech received during the current segment using the activated weighted grammar generated for the current segment. The method can further include assigning probability to the weighted grammar based on historical user responses and activating each weighted grammar is based on the assigned probability. Weighted grammars can be generated based on a user profile. A weighted grammar can be generated for two or more segments. Exclusively activating each weighted grammar can include a transition period blending the previously activated grammar and the grammar to be activated.

## Claims

### Claim 1

A method comprising:
identifying, via a processor and as part of a dialogue with a dialog system, a first segment of a dialog turn and a second segment of the dialog turn;
activating a first weighted grammar for the first segment to process first user speech received during the first segment, to yield a first activated weighted grammar, wherein the first weighted grammar is weighted based on a user profile which comprises one or more of information about a number called from, demographic information, account information, a time of day, and a date;
activating a second weighted grammar for the second segment of the dialog to process second user speech received during the second segment, to yield a second activated weighted grammar;
recognizing the first user speech received during the first segment of the dialog using the first activated weighted grammar; and
recognizing the second user speech received during the second segment of the dialog using the second activated weighted grammar.

### Claim 2 (depends on 1)

The method of claim 1, further comprising assigning a first probability to the first weighted grammar and a second probability to the second weighted grammar based on historical user responses and activating the first weighted grammar based on the first probability and activating the second weighted grammar based on the second probability.

### Claim 3 (depends on 1)

The method of claim 1, further comprising weighting a grammar based on an expected probable user response, to yield the first weighted grammar.

### Claim 4 (depends on 1)

The method of claim 1, wherein activating the first weighted grammar further comprises initiating a transition period blending a previously activated grammar and the first weighted grammar.

### Claim 5 (depends on 1)

The method of claim 1, wherein two identified segments are associated with the first weighted grammar.

### Claim 6 (depends on 1)

The method of claim 1, further comprising presenting a menu to a user using the dialog system prior to receiving the first user speech or the second user speech.

### Claim 7 (depends on 1)

The method of claim 1, wherein at least one of the first segment and the second segment are identified based on a first timing of a first probable user response and a second timing of a second probable user response.

### Claim 8

A system comprising:
a processor; and
a computer-readable storage medium having instructions stored which, when executed on the processor, cause the processor to perform operations comprising:
identifying, as part of a dialogue with a dialog system, a first segment of a dialog turn and a second segment of the dialog turn;
activating a first weighted grammar for the first segment to process first user speech received during the first segment, to yield a first activated weighted grammar, wherein the first weighted grammar is weighted based on a user profile which comprises one or more of information about a number called from, demographic information, account information, a time of day, and a date;
activating a second weighted grammar for the second segment of the dialog to process second user speech received during the second segment, to yield a second activated weighted grammar;
recognizing the first user speech received during the first segment of the dialog using the first activated weighted grammar; and
recognizing the second user speech received during the second segment of the dialog using the second activated weighted grammar.

### Claim 9 (depends on 8)

The system of claim 8, wherein the computer-readable storage medium stores additional instructions stored which, when executed on the processor, cause the processor to perform operations comprising:
assigning a first probability to the first weighted grammar and a second probability to the second weighted grammar based on historical user responses and activating the first weighted grammar based on the first probability and activating the second weighted grammar based on the second probability.

### Claim 10 (depends on 8)

The system of claim 8, wherein the computer-readable storage medium stores additional instructions stored which, when executed on the processor, cause the processor to perform operations comprising:
weighting a grammar based on an expected probable user response, to yield the first weighted grammar.

### Claim 11 (depends on 8)

The system of claim 8, wherein activating the first weighted grammar further comprises initiating a transition period blending a previously activated grammar and the first weighted grammar.

### Claim 12 (depends on 8)

The system of claim 8, wherein two identified segments are associated with the first weighted grammar.

### Claim 13 (depends on 8)

The system of claim 8, wherein the computer-readable storage medium stores additional instructions stored which, when executed on the processor, cause the processor to perform operations comprising:
presenting a menu to a user using the dialog system prior to receiving the first user speech or the second user speech.

### Claim 14 (depends on 8)

The system of claim 8, wherein at least one of the first segment and the second segment are identified based on a first timing of a first probable user response and a second timing of a second probable user response.

### Claim 15

A computer-readable storage device having instructions stored which, when executed on a computing device, cause the computing device to perform operations comprising:
identifying, as part of a dialogue with a dialog system, a first segment of a dialog turn and a second segment of the dialog turn;
activating a first weighted grammar for the first segment to process first user speech received during the first segment, to yield a first activated weighted grammar, wherein the first weighted grammar is weighted based on a user profile which comprises one or more of information about a number called from, demographic information, account information, a time of day, and a date;
activating a second weighted grammar for the second segment of the dialog to process second user speech received during the second segment, to yield a second activated weighted grammar;
recognizing the first user speech received during the first segment of the dialog using the first activated weighted grammar; and
recognizing the second user speech received during the second segment of the dialog using the second activated weighted grammar.

### Claim 16 (depends on 15)

The computer-readable storage device of claim 15, wherein the computer-readable storage device stores additional instructions stored which, when executed on the computing device, cause the computing device to perform operations further comprising:
assigning a first probability to the first weighted grammar and a second probability to the second weighted grammar based on historical user responses and activating the first weighted grammar based on the first probability and activating the second weighted grammar based on the second probability.

### Claim 17 (depends on 15)

The computer-readable storage device of claim 15, wherein the computer-readable storage device stores additional instructions stored which, when executed on the computing device, cause the computing device to perform operations further comprising:
weighting a grammar based on an expected probable user response, to yield the first weighted grammar.

### Claim 18 (depends on 15)

The computer-readable storage device of claim 15, wherein activating the first weighted grammar further comprises initiating a transition period blending a previously activated grammar and the first weighted grammar.

### Claim 19 (depends on 15)

The computer-readable storage device of claim 15, wherein two identified segments are associated with the first weighted grammar.

### Claim 20 (depends on 15)

The computer-readable storage device of claim 15, wherein the computer-readable storage device stores additional instructions stored which, when executed on the computing device, cause the computing device to perform operations further comprising:
presenting a menu to a user using the dialog system prior to receiving the first user speech or the second user speech.
