Back to results
US 9,805,713 B2Granted
Addressing missing features in models
AssigneeGoogle Inc.
InventorsFadi Biadsy, Diamantino Antonio Caseiro
Life of this patent
Estimating the term…
Abstract
Systems and methods for addressing missing features in models are provided. In some implementations, a model configured to indicate likelihoods of different outcomes is accessed. The model includes a respective score for each of a plurality of features, and each feature corresponds to an outcome in an associated context. It is determined that the model does not include a score for a feature corresponding to a potential outcome in a particular context. A score is determined for the potential outcome in the particular context based on the scores for one or more features in the model that correspond to different outcomes in the particular context. The model and the score are used to determine a likelihood of occurrence of the potential outcome.
Claims20
A method performed by one or more computers of an automated speech recognition system, the method comprising:
- receiving data indicating a candidate transcription for an utterance and a particular context for the utterance;
- accessing a language model of the automated speech recognition system, the language model including a respective score for each of a plurality of features, each feature corresponding to a word or phrase occurring in an associated context that includes one or more preceding words, wherein the automated speech recognition system is configured to obtain a score for a feature such that:
- (i) if the language model includes a score for the feature, the one or more computers retrieve the score for the feature that is included in the language model, and
- (ii) if the language model does not include a score for the feature, the one or more computers obtain a score for the feature that is based on scores for other features associated with a same context as the feature;
- determining that the language model does not include a score for a feature corresponding to the candidate transcription in the particular context;
- in response to determining that the language model does not include a score for a feature corresponding to the candidate transcription in the particular context, operating the automated speech recognition system to obtain a score corresponding to the candidate transcription in the particular context, wherein the score is determined based on one or more scores included in the language model for one or more of the plurality of features that are associated with the particular context;
- determining, using the language model and the determined score, a probability score indicating a likelihood of occurrence of the candidate transcription in the particular context;
- selecting, based on the probability score, a transcription for the utterance from among a plurality of candidate transcriptions;
- and
- providing the selected transcription to a client device as output of the automated speech recognition system.
7 more elements
An automated speech recognition system comprising:
- one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
- receiving data indicating a candidate transcription for an utterance and a particular context for the utterance;
- accessing a language model of the automated speech recognition system, the language model including a respective score for each of a plurality of features, each feature corresponding to a word or phrase occurring in an associated context that includes one or more preceding words, wherein the automated speech recognition system is configured to obtain a score for a feature such that:
- (i) if the language model includes a score for the feature, the one or more computers retrieve the score for the feature that is included in the language model, and
- (ii) if the language model does not include a score for the feature, the one or more computers obtain a score for the feature that is based on scores for other features associated with a same context as the feature;
- determining that the language model does not include a score for a feature corresponding to the candidate transcription in the particular context;
- in response to determining that the language model does not include a score for a feature corresponding to the candidate transcription in the particular context, operating the automated speech recognition system to obtain a score corresponding to the candidate transcription in the particular context, wherein the score is determined based on one or more scores included in the language model for one or more of the plurality of features that are associated with the particular context;
- determining, using the language model and the determined score, a probability score indicating a likelihood of occurrence of the candidate transcription in the particular context;
- selecting, based on the probability score, a transcription for the utterance from among a plurality of candidate transcriptions;
- and
- providing the selected transcription to a client device as output of the automated speech recognition system.
8 more elements
A non-transitory computer readable storage medium storing instructions that, when executed by one or more computers of an automated speech recognition system, cause the one or more computers to perform operations comprising:
- receiving data indicating a candidate transcription for an utterance and a particular context for the utterance;
- accessing a language model of the automated speech recognition system, the language model including a respective score for each of a plurality of features, each feature corresponding to a word or phrase occurring in an associated context that includes one or more preceding words, wherein the automated speech recognition system is configured to obtain a score for a feature such that:
- (i) if the language model includes a score for the feature, the one or more computers retrieve the score for the feature that is included in the language model, and
- (ii) if the language model does not include a score for the feature, the one or more computers obtain a score for the feature that is based on scores for other features associated with a same context as the feature;
- determining that the language model does not include a score for a feature corresponding to the candidate transcription in the particular context;
- in response to determining that the language model does not include a score for a feature corresponding to the candidate transcription in the particular context, operating the automated speech recognition system to obtain a score corresponding to the candidate transcription in the particular context, wherein the score is determined based on one or more scores included in the language model for one or more of the plurality of features that are associated with the particular context;
- determining, using the language model and the determined score, a probability score indicating a likelihood of occurrence of the candidate transcription in the particular context;
- selecting, based on the probability score, a transcription for the utterance from among a plurality of candidate transcriptions;
- and
- providing the selected transcription to a client device as output of the automated speech recognition system.
7 more elements
Dependencies are inferred from the claim text.