Updating language databases using crowd-sourced input
AssigneeNuance Communications, Inc.
InventorsChristopher Breske, Ethan Bradford, David Field, Wendy Bannister
Life of this patent
Estimating the term…
Abstract
Technology is described for refining a language model for a language recognition system based on aggregating and analyzing word tag metadata from multiple users of the language. The technology allows a user to mark a word or phrase in a selected language (e.g., as offensive or misspelled, or as a part of speech or other category), combines information collected from multiple users of the selected language, and updates the user's language model based on the combined information from multiple users of the selected language.
Claims20
A computer-readable memory having contents configured to cause at least one computer having a processor to perform a method for refining a language model used by language recognition systems, the method comprising:
- providing a language model for a selected language to various computing devices of multiple users of the selected language;
- offering an interface for user input to delete a word from the language model;
- receiving a user's input to delete a word from the language model;
- in response to the input to delete a word from the language model, prompting the user to provide information about the deletion;
- receiving information about the deletion, in response to the prompting;
- collecting, from the various computing devices, the received information about the multiple users' deletions of words in the selected language;
- aggregating the collected information from the various computing devices about the deletions;
- generating updates to the language model based on the aggregated information about the deletions;
- and
- providing the generated language model updates to the various computing devices.
A method in a computing system of assisting in refining a language model used by a language recognition system to predict words in a language, the method comprising:
- receiving a selection of a word in the language by a user of the computing system;
- providing an interface on the computing system for the user to associate at least one category with the selected word;
- receiving, via the interface, user input associating a category with the selected word;
- recording the received category association information in a language model on the computing system;
- transmitting the recorded category association information to a remote computer;
- and
- receiving updates to the language model on the computing system based on additional information associating one or more words in the language with one or more categories by other users of the language.
A system for assisting in refining a language model used by a language recognition system to predict words in a language, the system comprising:
- at least one memory storing computer-executable instructions of:
- a component configured to receive user language model events from each of multiple computing devices;
- wherein a plurality of language model events include user metadata classifying a word;
- a component configured to aggregate, in a crowd-sourced language model, the metadata about the classifications of the words in the language on the multiple computing devices;
- a component configured to compare aggregated metadata classification statistics to one or more thresholds;
- a component configured to classify a word in the crowd-sourced language model based on the comparison meeting one or more thresholds;
- a component configured to generate updates to the crowd-sourced language model based on the classification of a word in the language;
- and
- a component configured to provide the generated updates to each of the multiple computing devices;
- and
- at least one processor for executing the computer-executable instructions stored in the at least one memory.
Dependencies are inferred from the claim text.