Automatic speech recognition
AssigneeAmazon Technologies, Inc.
InventorsJing Liu, Feng-Ju Chang, Athanasios Mouchtaris, Martin Radfar, Maurizio Omologo, Siegfried Kunzmann
Life of this patent
Estimating the term…
Abstract
Techniques for performing automatic speech recognition (ASR) are described. In some embodiments, an ASR component integrates contextual information from user profile data into audio encoding data to predict a token(s) corresponding to a spoken input. The user profile data may include personalized words, such as, contact names, device names, etc. The ASR component determines word embedding data using the personalized words. The ASR component is configured to apply attention to audio frames that are relevant to the personalized words based on processing the audio encoding data and the word embedding data.
Claims20
A computer-implemented method comprising:
- receiving input data corresponding to a natural language input;
- determining user profile data corresponding to the input data;
- determining first encoding data using at least a first word included in the user profile data;
- determining second encoding data corresponding to at least a first portion of the input data;
- processing the first encoding data and the second encoding data to determine model input data;
- processing the model input data using a machine learning model to determine at least a first token;
- and
- processing the first token to determine output data representing a response to the natural language input, wherein the response is based at least in part on the user profile data.
A system comprising:
- at least one processor;
- and
- at least one memory including instructions that, when executed by the at least one processor, cause the system to:
- receive input data corresponding to a natural language input;
- determine user profile data corresponding to the input data;
- determine first encoding data using at least a first word included in the user profile data;
- determine second encoding data corresponding to at least a first portion of the input data;
- process the first encoding data and the second encoding data to determine model input data;
- process the model input data using a machine learning model to determine at least a first token;
- and
- process the first token to determine output data representing a response to the natural language input, wherein the response is based at least in part on the user profile data.
Dependencies are inferred from the claim text.