Systems and methods for analysis of data stored in a large dataset

A system for detecting at least one anomaly in a dataset, comprising:

• a program store storing code;
• a data repository storing a dataset including a plurality of data entities each including at least one value;
• a processor coupled to the data repository and to the program store for implementing the stored code, the code comprising:
• code to receive a semantic model that defines associations between two or more data entities;
• code to form a plurality of multi dimensional data instances, each multi dimensional data instance formed from at least one of a permutation and a combination of a set of data entities from the plurality of data entities according to the semantic model, and analyze the multi dimensional data instances to detect at least one anomalous value, the anomalous value representing a statistically significant deviation according to a deviation requirement, of one or more values from a set of values of the multi dimensional data instances;
• and
• code to provide the detected at least one anomalous value.

A computer program product comprising a non-transitory computer readable storage medium storing program code thereon for implementation by a processor of a system for detecting at least one anomaly in a dataset, comprising:

• instructions to manage a dataset including a plurality of data entities each including at least one value;
• instructions to receive a semantic model that defines associations between two or more data entities;
• instructions to form a plurality of multi dimensional data instances, each multi dimensional data instance formed from at least one of a permutation and a combination of a set of data entities from the plurality of data entities according to the semantic model;
• instructions to analyze the multi dimensional data instances to detect at least one anomalous value, the anomalous value representing a statistically significant deviation according to a deviation requirement, of one or more values from a set of values of the multi dimensional data instances;
• and
• instructions to provide the detected at least one anomalous value.