US 10,872,205 B2 · Process for identifying completion of domain adaptation dictionary activities

Abstract

An apparatus comprising a memory and a processor configured for semi-autonomous natural language processing domain adaptation related activities. The processor coupled to the memory and configured to identify a corpus of documents of an evaluation domain and generate a first lexicon based on the corpus of documents of the evaluation domain, and determine a threshold that indicates a sufficiency of domain adaptation of the evaluation domain based at least in part on the first lexicon. The processor is further configured to identify a corpus of documents of a client domain, generate a second lexicon based on the corpus of documents of the client domain, determine a metric associated with the corpus of documents of the client domain and the second lexicon, and determine that domain adaptation of the client domain is complete when the metric exceeds the threshold.

Claims20

Dependent claims

A computer-implemented method comprising:

identifying, by a processor, a corpus of documents from within a domain;
determining, by the processor, an evaluation question for use with a question answering system to determine an answer to the evaluation question based on content of the domain;
partitioning the corpus of documents into a plurality of sub-corpora;
generating a lexicon for each of the respective sub-corpora;
generating a plurality of test systems each corresponding uniquely to one of the plurality of sub-corpora;
evaluating the evaluation question using the plurality of test systems to determine a plurality of evaluation results each corresponding uniquely to one of the plurality of test systems;
and
determining a threshold for sufficiency of domain adaptation based on at least one of the evaluation results.

5 more elements

An apparatus comprising:

a memory comprising computer-readable instructions;
and
a processor coupled to the memory and configured to execute the instructions, which causes the processor to be configured to:
identify a corpus of documents from within a domain;
determine an evaluation question for use with a question answering system to determine an answer to the evaluation question based on content of the domain;
partition the corpus of documents into a plurality of sub-corpora;
generate a lexicon for each of the respective sub-corpora;
generate a plurality of test systems each corresponding uniquely to one of the plurality of sub-corpora;
evaluate the evaluation question using the plurality of test systems to determine a plurality of evaluation results each corresponding uniquely to one of the plurality of test systems;
and
determine a threshold for sufficiency of domain adaptation based on at least one of the evaluation results.

8 more elements

A computer program product for performing domain adaptation of a domain, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:

identify a corpus of documents from within a domain;
determine an evaluation question for use with a question answering system to determine an answer to the evaluation question based on content of the domain;
partition the corpus of documents into a plurality of sub-corpora;
generate a lexicon for each of the respective sub-corpora;
generate a plurality of test systems each corresponding uniquely to one of the plurality of sub-corpora;
evaluate the evaluation question using the plurality of test systems to determine a plurality of evaluation results each corresponding uniquely to one of the plurality of test systems;
and
determine a threshold for sufficiency of domain adaptation based on at least one of the evaluation results.

5 more elements

Dependencies are inferred from the claim text.

Process for identifying completion of domain adaptation dictionary activities

Life of this patent

Process for identifying completion of domain adaptation dictionary activities

Life of this patent

Abstract

Claims20