Back to results
US 9,317,594 B2Granted
Social community identification for automatic document classification
AssigneeSAS Institute Inc.
InventorsBarry de Ville, Gurpreet Bawa
Life of this patent
Estimating the term…
Abstract
Systems and methods for identifying data files that have a common characteristic are provided. A plurality of data files are received. The plurality of data files include one or more data files having the common characteristic. A list of key terms is generated from the plurality of data files. Data files from the plurality of data files that have an association with a social community are identified, where the social community is defined by one or more features. The list of key terms is updated based on an analysis of the identified features. The updated list of key terms is used to identify other data files that have the common characteristic.
Claims41
A computer-implemented method for identifying data files that have a common characteristic, the method comprising:
- receiving a plurality of data files including one or more data files having the common characteristic;
- generating a list of key terms from the plurality of data files;
- classifying each data file of the plurality of data files within a hierarchical structure, the hierarchical structure including upper nodes and lower nodes configured to group data files having similar characteristics, wherein a data file is classified within a lower node of the hierarchical structure based on a psychological characteristic of the classified data file, wherein the psychological characteristic indicates a psychological state of the creator of the classified data file;
- identifying data files from the plurality of data files having an association with a social community, the social community being a homogenous sub-group of a larger population defined by one or more features, wherein the identified data files having the association with the social community are classified within a particular node of the hierarchical structure that is defined by the one or more features;
- updating the list of key terms based on an analysis of the identified data files;
- and
- using the updated list of key terms to identify other data files that have the common characteristic.
4 more elements
A system for identifying data files that have a common characteristic, the system comprising:
- one or more processors;
- and
- one or more non-transitory computer-readable storage mediums containing instructions configured to cause the one or more processors to perform operations including:
- receiving a plurality of data files including one or more data files having the common characteristic;
- generating a list of key terms from the plurality of data files;
- classifying each data file of the plurality of data files within a hierarchical structure, the hierarchical structure including upper nodes and lower nodes configured to group data files having similar characteristics, wherein a data file is classified within a lower node of the hierarchical structure based on a psychological characteristic of the classified data file, wherein the psychological characteristic indicates a psychological state of the creator of the classified data file;
- identifying data files from the plurality of data files having an association with a social community, the social community being a homogenous sub-group of a larger population defined by one or more features, wherein the identified data files having the association with the social community are classified within a particular node of the hierarchical structure that is defined by the one or more features;
- updating the list of key terms based on an analysis of the identified data files;
- and
- using the updated list of key terms to identify other data files that have the common characteristic.
7 more elements
A computer program product for identifying data files that have a common characteristic, tangibly embodied in a machine-readable non-transitory storage medium, including instructions configured to cause a data processing system to:
- receive a plurality of data files including one or more data files having the common characteristic;
- generate a list of key terms from the plurality of data files;
- classify each data file of the plurality of data files within a hierarchical structure, the hierarchical structure including upper nodes and lower nodes configured to group data files having similar characteristics, wherein a data file is classified within a lower node of the hierarchical structure based on a psychological characteristic of the classified data file, wherein the psychological characteristic indicates a psychological state of the creator of the classified data file;
- identify data files from the plurality of data files having an association with a social community, the social community being a homogenous sub-group of a larger population defined by one or more features, wherein the identified data files having the association with the social community are classified within a particular node of the hierarchical structure that is defined by the one or more features;
- update the list of key terms based on an analysis of the identified data files;
- and
- use the updated list of key terms to identify other data files that have the common characteristic.
4 more elements
A system for generating a list of key terms from a plurality of data files, the system comprising:
- a processor;
- and
- a non-transitory computer-readable storage medium containing instructions configured to cause the processor to perform operations including:
- receiving a plurality of data files including one or more data files having a common characteristic, the common characteristic comprising a subject matter or a topic;
- generating a list of key terms from the received plurality of data files;
- classifying each data file of the received plurality of data files within a hierarchical structure, the hierarchical structure including nodes configured to group data files having similar features, wherein a data file is classified within a node of the hierarchical structure based on a psychological characteristic of the classified data file, wherein the psychological characteristic indicates a psychological state of the creator of the classified data file;
- identifying a group of data files having an association with the node of the hierarchical structure, the node being associated with a social community, the social community being a homogenous sub-group of a larger population;
- extracting features from the identified group of data files, the features including words related to the common characteristic;
- and
- updating the generated list of key terms based on the extracted features.
7 more elements
A system for generating a list of key terms from a plurality of data files, the system comprising:
- a processor;
- and
- a non-transitory computer-readable storage medium containing instructions configured to cause the processor to perform operations including:
- receiving the plurality of data files from a text corpus;
- calculating categories or topics from the received plurality of data files;
- extracting the list of key terms from the received plurality of data files based on the calculated categories or topics;
- classifying the received plurality of data files within a hierarchical structure, the hierarchical structure including nodes configured to group data files having similar features that define a homogenous sub-group of a larger population, wherein a data file is classified within a node of the hierarchical structure based on a psychological characteristic of the classified data file, wherein the psychological characteristic indicates a psychological state of the creator of the classified data file;
- identifying a group of data files having an association with the node of the hierarchical structure;
- extracting features from the identified group of data files, the features including words related to one or more of the calculated categories or topics;
- computing combinations or permutations of the extracted features;
- and
- using the extracted features and the combinations or permutations to update the list of key terms.
9 more elements
Dependencies are inferred from the claim text.