Dataset adaptation for high-performance in specific natural language processing tasks
AssigneeInternational Business Machines Corporation
InventorsDavid MARTINEZ IRAOLA, Sheng Hua BAO, Donna K. BYRON, Priscilla MORAES
Life of this patent
Estimating the term…
Abstract
Systems, methods, and computer program products to perform an operation comprising identifying a first available dataset having a degree of similarity to a received input dataset that exceeds a similarity threshold, determining, based on a plurality of features of the first available dataset and a plurality of features of the input dataset, a set of recommendations for transforming the input dataset, and transforming a text of the input dataset based on the set of recommendations and to optimize the input dataset for processing by a natural language processing (NLP) algorithm.
Claims20
A method comprising:
- identifying a first available dataset having a degree of similarity to a received input dataset that exceeds a similarity threshold;
- determining, based on a plurality of features of the first available dataset and a plurality of features of the input dataset, a set of recommendations for transforming the input dataset;
- and
- transforming a text of the input dataset based on the set of recommendations and to optimize the input dataset for processing by a natural language processing (NLP) algorithm.
A computer program product, comprising:
- a non-transitory computer-readable storage medium having computer readable program code embodied therewith, the computer readable program code executable by a processor to perform an operation comprising:
- identifying a first available dataset having a degree of similarity to a received input dataset that exceeds a similarity threshold;
- determining, based on a plurality of features of the first available dataset and a plurality of features of the input dataset, a set of recommendations for transforming the input dataset;
- and
- transforming a text of the input dataset based on the set of recommendations and to optimize the input dataset for processing by a natural language processing (NLP) algorithm.
A system, comprising:
- a processor;
- and
- a memory storing one or more instructions which, when executed by the processor, performs an operation comprising:
- identifying a first available dataset having a degree of similarity to a received input dataset that exceeds a similarity threshold;
- determining, based on a plurality of features of the first available dataset and a plurality of features of the input dataset, a set of recommendations for transforming the input dataset;
- and
- transforming a text of the input dataset based on the set of recommendations and to optimize the input dataset for processing by a natural language processing (NLP) algorithm.
Dependencies are inferred from the claim text.