Scalable ground truth disambiguation
AssigneeInternational Business Machines Corporation
InventorsFaheem Altaf, Lisa Seacat Deluca, Raghuram Srinivas
Life of this patent
Estimating the term…
Abstract
Methods, computer program products, and systems are presented. The methods include, for instance: obtaining an utterance input from a user agent, and collecting context data of the utterance input. A context tag is generated based on the context data, and one or more ground truth having respective utterance semantically identical to the utterance input is selected. Semantical relationship between the context tag and an intent of the selected ground truth is examined and the selected ground truth is updated with the context tag.
Claims20
A computer implemented method comprising:
- obtaining an utterance input from a user agent;
- collecting context data of the utterance input from the user agent, wherein the context data describes circumstances of the utterance input;
- generating a context tag based on the context data, wherein the context tag corresponds to the utterance input;
- selecting a ground truth, wherein the selecting includes using the utterance input and the context tag, wherein the ground truth includes an utterance and an intent, wherein the utterance of the ground truth is semantically identical to the utterance input, and wherein the intent of the ground truth is semantically consistent with the context tag;
- and
- updating the ground truth, wherein the updating includes attaching the context tag.
A computer program product comprising:
- a computer readable storage medium readable by one or more processing circuit and storing instructions for execution by one or more processor for performing a method comprising:
- obtaining an utterance input from a user agent;
- collecting context data of the utterance input from the user agent, wherein the context data describes circumstances of the utterance input;
- generating a context tag based on the context data, wherein the context tag corresponds to the utterance input;
- selecting a ground truth, wherein the selecting includes using the utterance input and the context tag, wherein the ground truth includes an utterance and an intent, wherein the utterance of the ground truth is semantically identical to the utterance input, and wherein the intent of the ground truth is semantically consistent with the context tag;
- and
- updating the ground truth, wherein the updating includes attaching the context tag.
A system comprising:
- a memory;
- one or more processor in communication with the memory;
- and
- program instructions executable by the one or more processor via the memory to perform a method comprising:
- obtaining an utterance input from a user agent;
- collecting context data of the utterance input from the user agent, wherein the context data describes circumstances of the utterance input;
- generating a context tag based on the context data, wherein the context tag corresponds to the utterance input;
- selecting a ground truth, wherein the selecting includes using the utterance input and the context tag, wherein the ground truth includes an utterance and an intent, wherein the utterance of the ground truth is semantically identical to the utterance input, and wherein the intent of the ground truth is semantically consistent with the context tag;
- and
- updating the ground truth, wherein the updating includes attaching the context tag.
Dependencies are inferred from the claim text.