US 12,001,791 B1 · Systems and methods for screening data instances based on a target text of a target corpus

Abstract

Systems, apparatuses, methods, and computer program products are disclosed for screening data instances based on a target text of a target corpus. A screening device analyzes a target corpus to generate at least two term dictionaries for the target corpus. The screening apparatus, based on a frequency of a term in the target corpus, determines a term weight for the term; for each data instance, determines term scores for the data instance and the target text based on the term weights; filters the data instances based on the term scores, to generate a short list of data instances; determines term similarity scores between each data instance of the short list and target text based on the term weights; and provides a data instance determined to likely correspond to the target text and an indication of the corresponding term similarity score(s). A term is a word or an n-gram.

Claims20

Dependent claims

A method for screening data instances based on a target text of a target corpus, the method comprising:

identifying, by a processor of a screening device, a plurality of data instances for each target text of a target corpus;
for each data instance of the plurality of data instances, determining, by the screening device, a word score and an n-gram score for the data instance based on at least two term dictionaries associated with the target corpus;
filtering, by the screening device, the plurality of data instances based on the word score and the n-gram score corresponding to each data instance and at least one or more of a threshold word score or a threshold n-gram score, to generate a short list of data instances;
determining, by the screening device, term similarity scores for each data instance of the short list based on a term overlap function between a term present in at least a portion of the data instance and the term present in the target text, the term being a respective word or n-gram;
and
providing, by the screening device, at least one data instance of the short list and an indication of its corresponding term similarity score.

3 more elements

An apparatus for screening data instances based on a target text of a target corpus, the apparatus comprising:

processor circuitry configured to:
identify a plurality of data instances for each target text of a target corpus;
for each data instance of the plurality of data instances, determine a word score and an n-gram score for the data instance based on at least two term dictionaries associated with the target corpus;
filter the plurality of data instances based on the word score and the n-gram score corresponding to each data instance and at least one or more of a threshold word score or a threshold n-gram score, to generate a short list of data instances;
determine term similarity scores for each data instance of the short list based on a term overlap function between a term present in at least a portion of the data instance and the term present in the target text, the term being a respective word or n-gram;
and
provide at least one data instance of the short list and an indication of its corresponding term similarity score.

4 more elements

Dependencies are inferred from the claim text.

Systems and methods for screening data instances based on a target text of a target corpus

Life of this patent

Systems and methods for screening data instances based on a target text of a target corpus

Life of this patent

Abstract

Claims20