# US 2014/0156567 A1 · System and method for automatic document classification in ediscovery, compliance and legacy information clean-up > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0156567 A1 - Document ID: US20140156567A1 - Status: Published application - Kind: A1 - Application number: 13/693,075 - Filed: 2012-12-04 - Published: 2014-06-05 - Earliest claimed: 2012-12-04 - Assignees: Msc Intellectual Properties B.V. - Applicants: Msc Intellectual Properties B.V. - Inventors: Johannes Cornelis Scholtes - Web page: https://patentgrep.com/patent/US20140156567A1 ## CPC - G06N 5/02: Knowledge representation; Symbolic representation - G06F 16/00: Information retrieval; Database structures therefor; File system structures therefor - G06F 16/355: Creation or modification of classes or clusters - G06N 20/00: Machine learning - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A system, method and computer program product for automatic document classification, including an extraction module configured to extract structural, syntactical and/or semantic information from a document and normalize the extracted information; a machine learning module configured to generate a model representation for automatic document classification based on feature vectors built from the normalized and extracted semantic information for supervised and/or unsupervised clustering or machine learning; and a classification module configured to select a non-classified document from a document collection, and via the extraction module extract normalized structural, syntactical and/or semantic information from the selected document, and generate via the machine learning module a model representation of the selected document based on feature vectors, and match the model representation of the selected document against the machine learning model representation to generate a document category, and/or classification for display to a user. ## Claims ### Claim 1 A computer implemented system for automatic document classification, the system comprising: an extraction module configured to extract structural, syntactical and/or semantic information from a document and normalize the extracted information; a machine learning module configured to generate a model representation for automatic document classification based on feature vectors built from the normalized and extracted semantic information for supervised and/or unsupervised clustering or machine learning; and a classification module configured to select a non-classified document from a document collection, and via the extraction module extract normalized structural, syntactical and/or semantic information from the selected document, and generate via the machine learning module a model representation of the selected document based on feature vectors, and match the model representation of the selected document against the machine learning model representation to generate a document category, and/or classification for display to a user. ### Claim 2 (depends on 1) The system of claim 1, wherein the extracted information includes named entities, properties of entities, noun-phrases, facts, events, and/or concepts. ### Claim 3 (depends on 1) The system of claim 1, wherein the extraction module employs text-mining, language identification, gazetteers, regular expressions, noun-phrase identification with part-of-speech taggers, and/or statistical models and rules, and is configured to identify patterns, and the patterns include libraries, and/or algorithms shared among cases, and which can be tuned for a specific case, to generate case-specific semantic information. ### Claim 4 (depends on 1) The system of claim 1, wherein the extracted information is normalized by using normalization rules, groupers, thesauri, taxonomies, and/or string-matching algorithms. ### Claim 5 (depends on 1) The system of claim 1, wherein the model representation of the document is a TF-IDF document representation of the extracted information, and the clustering or machine learning includes a classifier based on decision trees, support vector machines (SVM), naïve-bayes classifiers, k-nearest neighbors, rules-based classification, Linear discriminant analysis (LDA), Maximum Entropy Markov Model (MEMM), scatter-gather clustering, and/or hierarchical agglomerate clustering (HAC). ### Claim 6 A computer implemented method for automatic document classification, the method comprising: extracting with an extraction module structural, syntactical and/or semantic information from a document and normalizing with the extraction module the extracted information; generating with a machine learning module a model representation for automatic document classification based on feature vectors built from the normalized and extracted semantic information for supervised and/or unsupervised clustering or machine learning; and selecting with a classification module a non-classified document from a document collection, and extracting via the extraction module normalized structural, syntactical and/or semantic information from the selected document, and generating via the machine learning module a model representation of the selected document based on feature vectors, and matching with the classification module the model representation of the selected document against the machine learning model representation and generating with the classification module a document category, and/or classification for display to a user. ### Claim 7 (depends on 6) The method of claim 6, wherein the extracted information includes named entities, properties of entities, noun-phrases, facts, events, and/or concepts. ### Claim 8 (depends on 6) The method of claim 6, wherein the extraction module employs text-mining, language identification, gazetteers, regular expressions, noun-phrase identification with part-of-speech taggers, and/or statistical models and rules, and is configured to identify patterns, and the patterns include libraries, and/or algorithms shared among cases, and which can be tuned for a specific case, to generate case-specific semantic information. ### Claim 9 (depends on 6) The method of claim 6, wherein the extracted information is normalized by using normalization rules, groupers, thesauri, taxonomies, and/or string-matching algorithms. ### Claim 10 (depends on 6) The method of claim 6, wherein the model representation of the document is a TF-IDF document representation of the extracted information, and the clustering or machine learning includes a classifier based on decision trees, support vector machines (SVM), naïve-bayes classifiers, k-nearest neighbors, rules-based classification, Linear discriminant analysis (LDA), Maximum Entropy Markov Model (MEMM), scatter-gather clustering, and/or hierarchical agglomerate clustering (HAC). ### Claim 11 A computer program product for automatic document classification and including one or more computer readable instructions embedded on a tangible, non-transitory computer readable medium and configured to cause one or more computer processors to perform the steps of: extracting with an extraction module structural, syntactical and/or semantic information from a document and normalizing with the extraction module the extracted information; generating with a machine learning module a model representation for automatic document classification based on feature vectors built from the normalized and extracted semantic information for supervised and/or unsupervised clustering or machine learning; and selecting with a classification module a non-classified document from a document collection, and extracting via the extraction module normalized structural, syntactical and/or semantic information from the selected document, and generating via the machine learning module a model representation of the selected document based on feature vectors, and matching with the classification module the model representation of the selected document against the machine learning model representation and generating with the classification module a document category, and/or classification for display to a user. ### Claim 12 (depends on 11) The computer program product of claim 11, wherein the extracted information includes named entities, properties of entities, noun-phrases, facts, events, and/or concepts. ### Claim 13 (depends on 11) The computer program product of claim 11, wherein the extraction module employs text-mining, language identification, gazetteers, regular expressions, noun-phrase identification with part-of-speech taggers, and/or statistical models and rules, and is configured to identify patterns, and the patterns include libraries, and/or algorithms shared among cases, and which can be tuned for a specific case, to generate case-specific semantic information. ### Claim 14 (depends on 11) The computer program product of claim 11, wherein the extracted information is normalized by using normalization rules, groupers, thesauri, taxonomies, and/or string-matching algorithms. ### Claim 15 (depends on 11) The computer program product of claim 11, wherein the model representation of the document is a TF-IDF document representation of the extracted information, and the clustering or machine learning includes a classifier based on decision trees, support vector machines (SVM), naïve-bayes classifiers, k-nearest neighbors, rules-based classification, Linear discriminant analysis (LDA), Maximum Entropy Markov Model (MEMM), scatter-gather clustering, and/or hierarchical agglomerate clustering (HAC).