Semantically conditioned voice activity detection
AssigneeSoundHound AI IP, LLC
InventorVictor Leitman
Life of this patent
Estimating the term…
Abstract
A method includes recognizing words comprised by a first utterance; interpreting the recognized words according to a grammar comprised by a domain; from the interpreting of the recognized words, determining a timeout period for the first utterance based on the domain of the first utterance; detecting end of voice activity in the first utterance; executing an instruction following an amount of time after detecting end of voice activity of the first utterance in response to the amount of time exceeding the timeout period, the executed instruction based at least in part on interpreting the recognized words.
Claims8
A method comprising:
- recognizing words within an utterance of a user by a speech recognition engine to generate one or more transcription hypotheses;
- interpreting, by a natural language understanding processor, the recognized words by comparing the transcription hypotheses to a plurality of semantic grammars respectively associated with a plurality of domains, each semantic grammar producing a probability score representing a likelihood that the utterance corresponds to the respective domain;
- from the interpreting of the recognized words, determining by the processor, a weighted-average timeout period for the utterance as a weighted average of domain-specific timeout values, each domain-specific timeout value being multiplied by its corresponding probability score and divided by a sum of the probability scores;
- detecting an end of voice activity in the first utterance using a voice activity detector coupled to a microphone sensor;
- and
- executing, by the processor, an instruction following an amount of time after detecting the end of voice activity, the instruction being executed in response to the amount of time exceeding the determined weighted-average timeout period, and being based at least in part on the interpreted words.
Dependencies are inferred from the claim text.