US 9,792,905 B2Granted

Apparatus and method for analysis of language model changes

AssigneeNuance Communications, Inc.

InventorsAllen Louis Gorin, John Grothendieck, Jeremy Huntley Greet Wright

Life of this patent

Estimating the term…

Loading patent…

Abstract

An apparatus, a method, and a machine-readable medium are provided for characterizing differences between two language models. A group of utterances from each of a group of time domains are examined. One of a significant word change or a significant word class change within the plurality of utterances is determined. A first cluster of utterances including a word or a word class corresponding to the one of the significant word change or the significant word class change is generated from the utterances. A second cluster of utterances not including the word or the word class corresponding to the one of the significant word change or the significant word class change is generated from the utterances.

Claims17

Dependent claims

A method comprising:

selecting, via a processor, a plurality of language models;
and
for each time period of a plurality of time periods:
identifying a first utterance and a second utterance received during each time period, wherein the first utterance was recognized using a first language model of the plurality of language models and the second utterance was recognized using a second language model of the plurality of language models;
identifying, via the processor, distinctions between the first utterance and the second utterance for each of the plurality of time periods, wherein the distinctions are identified by comparing phonemes between the first utterance and the second utterance;
determining, via the processor, when a significant word usage change has occurred within the first language model and the second language model by comparing the distinctions to previously recorded distinctions;
when the significant word usage change is detected, updating the plurality of language models according to the distinctions;
and
outputting a list of utterances on a graphical display with analytical information about the distinctions.

6 more elements

A system comprising:

a processor;
and
a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising:
selecting a plurality of language models;
and
for each time period of a plurality of time periods:
identifying a first utterance and a second utterance received during each time period, wherein the first utterance was recognized using a first language model of the plurality of language models and the second utterance was recognized using a second language model of the plurality of language models;
identifying distinctions between the first utterance and the second utterance for each of the plurality of time periods, wherein the distinctions are identified by comparing phonemes between the first utterance and the second utterance;
determining when a significant word usage change has occurred within the first language model and the second language model by comparing the distinctions to previously recorded distinctions;
when the significant word usage change is detected, updating the plurality of language models according to the distinctions;
and
outputting a list of utterances with analytical information about the distinctions.

9 more elements

A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:

selecting a plurality of language models;
and
for each time period of a plurality of time periods:
identifying a first utterance and a second utterance received during each time period, wherein the first utterance was recognized using a first language model of the plurality of language models and the second utterance was recognized using a second language model of the plurality of language models;
identifying distinctions between the first utterance and the second utterance for each of the plurality of time periods, wherein the distinctions are identified by comparing phonemes between the first utterance and the second utterance;
determining when a significant word usage change has occurred within the first language model and the second language model by comparing the distinctions to previously recorded distinctions;
when the significant word usage change is detected, updating the plurality of language models according to the distinctions;
and
outputting a list of utterances with analytical information about the distinctions.

6 more elements

Dependencies are inferred from the claim text.

Facts

Application: 14/541,694Filed 14 Nov 2014 · continuation
Priority: 21 Mar 2005
Published: US 2015/0073791 A112 Mar 2015
Granted: 17 Oct 2017
Term ends: Not estimatedThe source records don’t support an estimate.

Classification4 codes

G10L 15/183
Using natural language modelling: using context dependencies, e.g. language models
G10L 15/18
Speech classification or search: using natural language modelling
G10L 25/51
Specially adapted for particular use: for comparison or discrimination
G10L
Speech analysis techniques or speech synthesis

Family

Application11/085,382Parent of this continuation · filed 21 Mar 2005
Application12/881,665Parent of this continuation · filed 14 Sep 2010
US 7,805,300 B2Parent of this continuation · filed 28 Sep 2010
US 2015/0073791 A1Pre-grant publication · published 12 Mar 2015
US 8,892,438 B2Parent of this continuation
US 2006/0212294 A1Published application
US 2011/0093268 A1Published application
US 9,792,905 B2This patent

From the US filing history. Foreign family members aren’t listed.