Providing Answers To Voice Queries Using User Feedback
AssigneeGoogle Inc.
InventorsGabriel Taubman, Andrew W. Hoque, John J. Lee
Life of this patent
Estimating the term…
Abstract
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a dialog system using user feedback. According to one implementation, a method includes receiving, by a dialog engine and from a computing device, a voice input; determining, by the dialog engine, that the received voice input is classified as feedback to an answer of a question; identifying by the dialog engine, a predetermined feedback score associated with the feedback; and adjusting a confidence score associated with the question and the answer based on the predetermined feedback score.
Claims20
A computer-implemented method when executed by data processing hardware causes the data processing hardware to perform operations comprising:
- for each corresponding user device among multiple different user devices in communication with a digital assistant:
- receiving, from the corresponding user device, a particular question directed toward the digital assistant, the particular question input to the corresponding user device by a corresponding user during a dialog session with the digital assistant;
- providing, to the corresponding user device, a first answer corresponding to the particular question, the first answer paired with the particular question;
- and
- receiving, from the corresponding user device, negative feedback from the corresponding user, the negative feedback indicating dissatisfaction with the first answer to the particular question;
- and
- for another user device in communication with the digital assistant:
- receiving, from the other user device, the particular question directed toward the digital assistant, the particular question input by the other user device;
- and
- based on the negative feedback received from the multiple different user devices indicating dissatisfaction with the first answer to the particular question, providing, to the other user device, a second answer to the particular question, the second answer different than the first answer.
A system comprising:
- data processing hardware;
- and
- memory hardware in communication with the data processing hardware and storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
- for each corresponding user device among multiple different user devices in communication with a digital assistant:
- receiving, from the corresponding user device, a particular question directed toward the digital assistant, the particular question input to the corresponding user device by a corresponding user during a dialog session with the digital assistant;
- providing, to the corresponding user device, a first answer corresponding to the particular question, the first answer paired with the particular question;
- and
- receiving, from the corresponding user device, negative feedback from the corresponding user, the negative feedback indicating dissatisfaction with the first answer to the particular question;
- and
- for another user device in communication with the digital assistant:
- receiving, from the other user device, the particular question directed toward the digital assistant, the particular question input by the other user device;
- and
- based on the negative feedback received from the multiple different user devices indicating dissatisfaction with the first answer to the particular question, providing, to the other user device, a second answer to the particular question, the second answer different than the first answer.
Dependencies are inferred from the claim text.