Systems and methods of natural language processing
AssigneeNasdaq, Inc.
InventorsHyunsoo Jeong, Josep Puig Ruiz, Douglas Hamilton, Niharika Sharma
Life of this patent
Estimating the term…
Abstract
Natural language processing techniques provide sentence level analysis on one or more topics that are associated with keywords. Indirect learning is used to expand the understanding of the keywords and associated topics. Semantic similarity is used on a sentence-level to assess whether a given sentence relates or mentions a particular topic. In some examples, additional keywords are suggested using filtering techniques in connection with graph embedding-based entity linking techniques.
Claims20
A computer system for performing natural language processing, the computer system comprising:
- a processing system comprising instructions that, when executed by at least one hardware processor included in the processing system, cause the at least one hardware processor to perform operations comprising:
- obtaining target textual data;
- obtaining input data that includes at least one topic with a plurality of specified keywords for the at least one topic;
- for each corresponding one of the plurality of specified keywords for the at least one topic, performing a query to retrieve a descriptive text body that is associated with the corresponding one of the plurality of specified keywords, wherein the descriptive text body includes multiple different sentences;
- generating a first plurality of sentences from the target textual data;
- generating a second plurality of sentences from each of the descriptive text bodies retrieved in connection with each corresponding keyword;
- for each corresponding one of the first plurality of sentences, calculating a plurality of sentence similarity metrics between the corresponding one of the first plurality of sentences and each one of the sentences in the second plurality of sentences;
- and
- for each corresponding one of the first plurality of sentences, calculating a metric between the corresponding one of the first plurality of sentences and the at least one topic based on multiple ones of the calculated plurality of sentence similarity metrics for the corresponding one of the first plurality of sentences.
A method of performing natural language processing on a computer system, the method comprising:
- obtaining target textual data;
- obtaining input data that includes at least one topic with a plurality of specified keywords for the at least one topic;
- for each corresponding one of the plurality of specified keywords for the at least one topic, performing a query to retrieve an expanded body of text that is associated with the corresponding one of the plurality of specified keywords, wherein the expanded body of text includes multiple different sentences;
- generating a first plurality of sentences from the target textual data;
- generating a second plurality of sentences that is based on each of the expanded text bodies retrieved in connection with each corresponding keyword;
- for each corresponding one of the first plurality of sentences, calculating a plurality of sentence similarity metrics between the corresponding one of the first plurality of sentences and each one of the sentences in the second plurality of sentences;
- and
- for each corresponding one of the first plurality of sentences, calculating a metric between the corresponding one of the first plurality of sentences and the at least one topic based on multiple ones of the calculated plurality of sentence similarity metrics for the corresponding one of the first plurality of sentences.
A non-transitory computer readable storage medium storing instructions for use with a computer system, the computer system including at least one hardware processor, the stored instructions comprising instructions that are configured to cause at least on hardware processor to perform operations comprising:
- obtaining target textual data;
- obtaining input data that includes at least one topic with a plurality of specified keywords for the at least one topic;
- for each corresponding one of the plurality of specified keywords for the at least one topic, performing a query to retrieve an expanded body of text that is associated with the corresponding one of the plurality of specified keywords, wherein the expanded body of text includes multiple different sentences;
- generating a first plurality of sentences from the target textual data;
- generating a second plurality of sentences that is based on each of the expanded text bodies retrieved in connection with each corresponding keyword;
- for each corresponding one of the first plurality of sentences, calculating a plurality of sentence similarity metrics between the corresponding one of the first plurality of sentences and each one of the sentences in the second plurality of sentences;
- and
- for each corresponding one of the first plurality of sentences, calculating a metric between the corresponding one of the first plurality of sentences and the at least one topic based on multiple ones of the calculated plurality of sentence similarity metrics for the corresponding one of the first plurality of sentences.
Dependencies are inferred from the claim text.