Back to results
US 2020/0004869 A1Published application
Automatic generation of regular expressions for homogenous clusters of documents
Assigneesalesforce.com, inc.
InventorGaneswara Rao DULAM
Life of this patent
Estimating the term…
Abstract
Regular expressions are generated automatically by receiving documents, clustering the documents, and selecting tokens from the documents which occur in each document in the cluster, and generating a regular expression for each cluster of documents using the selected tokens.
Claims20
A computer implemented method for automatically generating regular expressions, the method comprising:
- receiving a first plurality of documents;
- generating a first plurality of homogenous clusters using the first plurality of documents, wherein each of the first plurality of documents is included in only one of the clusters, wherein each of the clusters includes one or more of the documents and wherein the documents in each cluster share certain characteristics more closely with each other than the documents of the other clusters in the first plurality of clusters;
- for each cluster in the first plurality of clusters:
- selecting a single document from the cluster;
- generating a first set of tokens from only the single document selected from the cluster, wherein an order of the first set of tokens is preserved from the single document selected from the cluster;
- identifying a second set of tokens in the first set of tokens that occur in each of the other documents in the cluster in the preserved order;
- generating a regular expression for the cluster using the second set of tokens and the preserved order;
- and
- providing the regular expressions for each of the first plurality of clusters to a document classifier.
6 more elements
A non-transitory machine-readable storage medium that provides instructions that, if executed by a processor, will cause said processor to perform operations comprising:
- receiving a first plurality of documents;
- generating a first plurality of homogenous clusters using the first plurality of documents, wherein each of the first plurality of documents is included in only one of the clusters, wherein each of the clusters includes one or more of the documents and wherein the documents in each cluster share certain characteristics more closely with each other than the documents of the other clusters in the first plurality of clusters;
- for each cluster in the first plurality of clusters:
- selecting a single document from the cluster;
- generating a first set of tokens from only the single document selected from the cluster, wherein an order of the first set of tokens is preserved from the single document selected from the cluster;
- identifying a second set of tokens in the first set of tokens that occur in each of the other documents in the cluster in the preserved order;
- generating a regular expression for the cluster using the second set of tokens and the preserved order;
- and
- providing the regular expressions for each of the first plurality of clusters to a document classifier.
6 more elements
An article of manufacture comprising:
- a processor;
- and
- a memory coupled to the processor, the memory storing instructions which, when executed by the processor, cause the article to:
- receive a first plurality of documents;
- generate a first plurality of homogenous clusters using the first plurality of documents, wherein each of the first plurality of documents is included in only one of the clusters, wherein each of the clusters includes one or more of the documents and wherein the documents in each cluster share certain characteristics more closely with each other than the documents of the other clusters in the first plurality of clusters;
- for each cluster in the first plurality of clusters:
- select a single document from the cluster;
- generate a first set of tokens from only the single document selected from the cluster, wherein an order of the first set of tokens is preserved from the single document selected from the cluster;
- identify a second set of tokens in the first set of tokens that occur in each of the other documents in the cluster in the preserved order;
- generate a regular expression for the cluster using the second set of tokens and the preserved order;
- and
- provide the regular expressions for each of the first plurality of clusters to a document classifier.
9 more elements
Dependencies are inferred from the claim text.