Knowledge enhanced spoken dialog system
AssigneeRobert Bosch GmbH
InventorsZhengyu ZHOU, Vikas YADAV, Yongliang HE, In Gyu CHOI
Life of this patent
Estimating the term…
Abstract
A spoken dialog system and methods of using the system is described. A method may comprise: receiving audible human speech from a user; determining textual speech data based on the audible human speech; extracting, from the audible human speech, signal speech data that is indicative of acoustic characteristics which correspond to the textual speech data; and using the textual speech data and the signal speech data, generating a response to the audible human speech.
Claims20
A method of response generation, comprising:
- receiving audible human speech from a user;
- determining textual speech data based on the audible human speech;
- extracting, from the audible human speech, signal speech data that is indicative of acoustic characteristics which correspond to the textual speech data;
- based on the textual speech data, determining, using a natural language understanding model, a text string comprising an ambiguation, wherein the ambiguation comprises a first interpretation of the text string and a second interpretation of the text string, wherein the first interpretation differs from the second interpretation;
- determining the first interpretation is most accurate by corresponding word boundaries determined from the text string with the acoustic characteristics determined from the signal speech data;
- and
- generating a response to the audible human speech based on the first interpretation.
A non-transitory computer-readable medium comprising a plurality of computer-executable instructions and memory for maintaining the plurality of computer-executable instructions, wherein the plurality of computer-executable instructions, when executed by one or more processors of a computer, perform the following function(s):
- receive audible human speech from a user;
- determine textual speech data based on the audible human speech;
- extract, from the audible human speech, signal speech data that is indicative of acoustic characteristics which correspond to the textual speech data;
- based on the textual speech data, determine, using a natural language understanding model, a text string comprising an ambiguation, wherein the ambiguation comprises a first interpretation of the text string and a second interpretation of the text string, wherein the first interpretation differs from the second interpretation;
- determine the first interpretation is most accurate by corresponding word boundaries determined from the text string with the acoustic characteristics determined from the signal speech data;
- and
- generate a response to the audible human speech based on the first interpretation.
A method of response generation, comprising:
- receiving audible human speech from a user;
- determining textual speech data based on the audible human speech;
- extracting, from the audible human speech, signal speech data that indicative of acoustic characteristics which correspond to the textual speech data;
- using a text-based sentiment analysis tool, determining that a sentiment analysis of the textual speech data is Positive or Neutral;
- using a signal-based sentiment analysis tool, determining that a sentiment analysis of the signal speech data is Negative;
- and
- based on the sentiment analyses of the textual and signal speech data, determining that the audible human speech comprises sarcasm.
Dependencies are inferred from the claim text.