Neural speech-to-meaning
AssigneeSoundHound AI IP, LLC
InventorsSudharsan Krishnaswamy, Maisy Wieman, Jonah Probell
Life of this patent
Estimating the term…
Abstract
A neural speech-to-meaning system is trained on speech audio expressing specific intents. The system receives speech audio and produces indications of when the speech in the audio matches the intent. Intents may include variables that can have a large range of values, such as the names of places. The neural speech-to-meaning system simultaneously recognizes enumerated values of variables and general intents. Recognized variable values can serve as arguments to API requests made in response to recognized intents. Accordingly, neural speech-to-meaning supports voice virtual assistants that serve users based on API hits.
Claims20
A machine for recognizing an intent in speech audio, the machine comprising:
- a variable recognizer that processes speech audio features, computes a probability of the speech audio having any of a plurality of enumerated variable values, and outputs the value with the highest probability;
- and
- an intent recognizer that processes speech audio features, computes a probability of the speech audio having the intent, and in response to the probability being above an intent threshold, produces a request for a virtual assistant action.
A method of recognizing an intent from speech audio by a computer system, the method comprising:
- obtaining speech audio;
- processing features of the speech audio to compute a probability of the speech audio having any of a plurality of enumerated variable values;
- outputting the value with the highest probability;
- processing the features of the speech audio to compute a probability of the speech audio having the intent;
- and
- in response to the probability being above an intent threshold, outputting a request for a virtual assistant action.
Dependencies are inferred from the claim text.