System and method for mining patterns from a dataset
AssigneeInternational Business Machines Corporation
InventorsWei Wang, Jiong Yang, Philips Shi-Lung Yu
Life of this patent
Estimating the term…
Abstract
A system and method are provided for discovering significant patterns from a list of records in a dataset. Each record includes a set of items, and each significant pattern includes a subset of items such that a significance of the pattern exceeds a significance level. A significance is computed for each item in the list of records to determine significant items. The records are randomly sampled to select a sample portion of the records. Ambiguous patterns are identified against the sample portion of the records and verified against the entire list of records in the dataset.
Claims27
A method for discovering significant patterns from a list of records in a dataset, wherein each record comprises a set of items and each significant pattern includes a subset of items such that a significance of the pattern exceeds a significance level, the method comprising the steps of:
- computing a significance for each item in the list of records to determine significant items;
- sampling the records randomly to select a sample portion of the records;
- identifying ambiguous patterns against the sample portion of the records;
- and
- verifying the ambiguous patterns against the entire list of records in the dataset.
A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for discovering significant patterns from a list of records in a dataset, wherein each record comprises a set of items and each significant pattern includes a subset of items such that a significance of the pattern exceeds a significance level, the method steps comprising:
- computing a significance for each item in the list of records to determine significant items;
- sampling the records randomly to select a sample portion of the records;
- identifying ambiguous patterns against the sample portion of the records;
- and
- verifying the ambiguous patterns against the entire list of records in the dataset.
A system for discovering significant patterns from a list of records of a dataset, comprising:
- a memory storage which stores the list of records, each record of the list of records including a set of items and each significant pattern including a subset of items such that the significance of the pattern exceeds a significance level;
- and
- a processor which determines significant items and generates a random sample of the records, the processor identifies sets of ambiguous patterns based on data obtained in the random sample of records and verifies the ambiguous patterns against the entire dataset such that the ambiguous patterns are pruned from the dataset.
Dependencies are inferred from the claim text.