Crowdsourced training of textual natural language understanding systems
AssigneeDefinedCrowd Corporation
InventorsDaniela Braga, Joao Freitas, Daan Baldewijns
Life of this patent
Estimating the term…
Loading patent…
AssigneeDefinedCrowd Corporation
InventorsDaniela Braga, Joao Freitas, Daan Baldewijns
Estimating the term…
A facility to crowdsource training of virtual assistants and other textual natural language understanding systems is described. The facility first specifies a set of possible user intents (e.g., a kind of question asked by users). As part of specifying an intent, entities, that represent salient items of information associated with the intent are identified. Then, for each of the intents, the facility directs users of a crowdsourcing platform to input a number of different textual queries they might use to express this intent. Then, additional crowdsourcing platform users are asked to perform semantic annotation of the cleaned queries, for each selecting its intent and entities from predefined lists. Next, still other crowdsourcing platform users are asked whether the selection of intents and entities during semantic annotation was correct for each query. Once validated, the annotated queries are used to train the assistant.
A method in a computing system for training a virtual assistant to operate with respect to a plurality of user intents, comprising:
At least one non-transitory, computer-readable medium carrying instructions, which when executed by at least one data processor, performs operations for training a virtual assistant to operate with respect to a plurality of user intents, the operations comprising:
A system for training a virtual assistant to operate with respect to a plurality of user intents, the system comprising:
Dependencies are inferred from the claim text.