Method and system for insightful phrase extraction from text
AssigneeVerizon Patent and Licensing Inc.
InventorsMiruna Jayakrishnasamy, Prakash Ranganathan
Life of this patent
Estimating the term…
Abstract
The present teaching relates to extracting insightful phrases from an input text. Independent contexts are first identified from the input text. With respect to each independent context, initial candidate phrases are generated with respect to linguistic features and are then filtered. Various features are then computed for each filtered candidate phrase and used to select top k candidate phrases for each independent context. A most insightful phrase is then selected from the k top candidate phrases using deep learned models. Such selected most insightful phrases for the independent contexts are then used for facilitating an understanding the input text.
Claims20
A method, comprising:
- receiving, at a device, an input text;
- identifying one or more independent contexts from the input text;
- for each of the one or more independent contexts, generating top k phrases by:
- obtaining a plurality of initial phrases based on one or more linguistic features,
- filtering the plurality of initial phrases to generate a plurality of filtered candidate phrases,
- computing phrase features for each of the plurality of filtered candidate phrases, and
- identifying the top k phrases from the plurality of filtered candidate phrases based on their respective phrase features;
- selecting, for each of the one or more independent contexts, a most insightful phrase from the top k phrases for the independent context based on deep learned models;
- and
- facilitating an understanding of the input text based on the selected one or more most insightful phrases.
A machine readable and non-transitory medium having information recorded thereon, wherein the information, when read by the machine, causes the machine to perform the following steps:
- receiving an input text based on which at least one insightful phrase is to be extracted;
- identifying one or more independent contexts from the input text;
- for each of the one or more independent contexts, generating top k phrases by:
- obtaining a plurality of initial phrases based on one or more linguistic features,
- filtering the plurality of initial phrases to generate a plurality of filtered candidate phrases,
- computing phrase features for each of the plurality of filtered candidate phrases, and
- identifying the top k phrases from the plurality of filtered candidate phrases based on their respective phrase features;
- selecting, for each of the one or more independent contexts, a most insightful phrase from the top k phrases for the independent context based on deep learned models, and
- facilitating an understanding of the input text based on the selected one or more most insightful phrases.
A system, comprising:
- an input text preprocessor implemented by a processor and configured for receiving an input text based on which at least one insightful phrase is to be extracted;
- an independent context identification mechanism implemented by a processor and configured for identifying one or more independent contexts from the input text;
- a phrase extraction engine implemented by a processor and configured for generating top k phrases, wherein for each of the one or more independent contexts, the top k phrases are generated by:
- obtaining a plurality of initial phrases based on one or more linguistic features,
- filtering the plurality of initial phrases to generate a plurality of filtered candidate phrases,
- computing phrase features for each of the plurality of filtered candidate phrases, and
- identifying the top k phrases from the plurality of filtered candidate phrases based on their respective phrase features;
- a model-based phrase selector implemented by a processor and configured for selecting, for each of the one or more independent contexts, a most insightful phrase from the top k phrases for the independent context based on deep learned models, and
- a processor for understanding the input text based on the selected one or more most insightful phrases.
Dependencies are inferred from the claim text.