Method and apparatus for selecting among competing models in a tool for building natural language understanding models
AssigneeNuance Communications, Inc.
InventorJeffrey N. Marcus
Life of this patent
Estimating the term…
Loading patent…
AssigneeNuance Communications, Inc.
InventorJeffrey N. Marcus
Estimating the term…
Selecting a grammar for use in a machine question-answering system, such as a Natural Language Understanding System, can be difficult for non-experts in such grammars. A tool, according to an example embodiment, can compare annotations of sample sentences, performed correctly by a human, the annotations having intents and mentions, against annotations performed by multiple grammars. Each grammar can be scored, and the system can select the best scored grammar for the user. In one embodiment, a method of selecting a grammar includes comparing manually-generated annotations against machine-generated annotations as a function of a given grammar among multiple grammars. The method can further include applying scores to the machine-generated annotations that are a function of weightings of the intents and mentions. The method can additionally include recommending whether to employ the given grammar based on the scores.
A method of selecting a grammar from among multiple grammars, the method comprising:
A system for selecting a grammar from among multiple grammars, the method comprising:
A non-transitory computer-readable medium configured to store instructions for selecting a grammar from among multiple grammars, the instructions, when loaded and executed by a processor, cause the processor to:
Dependencies are inferred from the claim text.