Back to results
US 9,934,777 B1Granted
Customized speech processing language models
AssigneeAmazon Technologies, Inc.
InventorsShaun Nidhiri Joseph, Sonal Pareek, Ariya Rastrow, Gautam Tiwari, Alexander David Rosen
Life of this patent
Estimating the term…
Abstract
User-specific language models (LMs) that include internal word indexes to a word table specific to the user-specific LM rather than a word table specific to a system-wide LM. When the system-wide LM is updated, the word table of the user-specific LM may be updated to translate the user-specific indices to system-wide indices. This prevents having to update the internal indices of the user-specific LM every time the system-wide LM is updated.
Claims20
A computer-implemented method for creating and using a user-specific language model, the method comprising, during a training period:
- identifying a first finite state transducer (FST) for automatic speech recognition (ASR), wherein the first FST corresponds to an ASR language model and is configured for use in processing audio data from a plurality of user devices;
- identifying a first table corresponding to the first FST, wherein the first table includes a first plurality of indexed entries, a first entry of the first plurality of indexed entries corresponding to a first word represented in the ASR language model;
- identifying music collection data associated with a first user profile, the music collection data including a plurality of word strings associated with a music collection corresponding to the first user profile, the plurality of word strings selected from among artist names, song titles and album titles;
- generating a second table corresponding to words in the plurality of word strings, wherein the second table includes:
- a first entry including a first word in the plurality of word strings and a first index value corresponding to a third entry in the first table corresponding to the first word, and
- a second entry including a second word in the plurality of word strings and a second index value corresponding to a fourth entry in the first table corresponding to the second word;
- generating a second FST corresponding to the music collection data, wherein the second FST includes a third index value corresponding to the first entry and a fourth index value corresponding to the second entry;
- and
- storing the second table and the second FST.
6 more elements
A computer-implemented method, comprising:
- identifying a first language model configured for speech processing corresponding to multiple devices;
- identifying a first table representing words corresponding to the first language model;
- identifying a plurality of word strings associated with a first user profile;
- creating a second language model configured for speech processing corresponding to the plurality of word strings, the second language model including a plurality of references to a second table;
- generating a second table representing words of the plurality of word strings, the second table including at least:
- a first entry including a first word in the plurality of word strings and a first index value corresponding to a third entry in the first table, the third entry corresponding to the first word, and
- a second entry including a second word in the plurality of word strings and a second index value corresponding to a fourth entry in the first table, the fourth entry corresponding to the second word;
- generating a second language model configured for speech processing corresponding to the first user profile, the second language model including a third index value corresponding to the first entry and a fourth index value corresponding to the second entry;
- and
- storing the second table and the second language model as associated with the first user profile.
7 more elements
A system, comprising:
- at least one processor;
- at least one memory device including instructions operable to be executed by the at least one processor to configure the system to:
- identify a first language model configured for speech processing corresponding to multiple devices;
- identify a first table representing words corresponding to the first language model;
- identify a plurality of word strings associated with a first user profile;
- generate a second language model configured for speech processing corresponding to the plurality of word strings, the second language model including a plurality of references to a second table;
- generate a second table representing words of the plurality of word strings, the second table including at least:
- a first entry including a first word in the plurality of word strings and a first index value corresponding to a third entry in the first table, the third entry corresponding to the first word, and
- a second entry including a second word in the plurality of word strings and a second index value corresponding to a fourth entry in the first table, the fourth entry corresponding to the second word;
- generate a second language model configured for speech processing corresponding to the first user profile, the second language model including a third index value corresponding to the first entry and a fourth index value corresponding to the second entry;
- and
- store the second table and the second language model as associated with the first user profile.
9 more elements
Dependencies are inferred from the claim text.