# US 2022/0036137 A1 · Method for detecting anomalies in a data set

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036137 A1
- Document ID: US20220036137A1
- Status: Published application
- Kind: A1
- Application number: 17/275,981
- Filed: 2018-09-19
- Published: 2022-02-03
- Earliest claimed: 2018-09-19
- Assignees: Rulex, Inc.
- Applicants: Rulex, Inc.
- Inventors: Marco Muselli; Massimiliano Costacurta; Damiano Verda; Enrico Ferrari
- Web page: https://patentgrep.com/patent/US20220036137A1

## CPC

- G06F 17/18: for evaluating statistical data {, e.g. average values, frequency distributions, probability functions, regression analysis (forecasting specially adapted for a specific administrative, business or logistic context G06Q10/04)}
- G06F 18/2178: {based on feedback of a supervisor}
- G06F 18/2155: {characterised by the incorporation of unlabelled data, e.g. multiple instance learning [MIL], semi-supervised techniques using expectation-maximisation [EM] or naïve labelling}
- G06F 18/23: Clustering techniques
- G06F 18/2415: based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
- G06F 18/2431: Multiple classes
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06N 20/00: Machine learning
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06N 3/08: Learning methods
- G06N 5/025: Extracting rules from data
- G06N 20/10: using kernel methods, e.g. support vector machines [SVM]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A computer-implemented method and system for detecting anomalies in an unlabeled data set of data records is provided. The method applies a classification method to a training data set obtained from the unlabeled data set to generate a classification model associating a predicted output class to each training data record. The predicted output class is compared with the original output class, in order to detect an anomalous data record in the presence of a discrepancy between the original and the predicted output class. The method may assign a confidence score to the predicted output class by the classification model, wherein the anomalous data record is detected on the basis of a threshold of the confidence score. For example, the classification method may be based on Boolean functions synthesis by a Shadow Clustering algorithm, and the classification model is in the form of a set of conditional rules.

## Claims

### Claim 1

A computer-implemented method for detecting anomalies in an unlabeled data set, wherein the unlabeled data set comprises data records of input variables and at least one output variable dependent from one or more input variables, said method comprising:
a. from the unlabeled data set, generating, by a computing device, a training data set comprising training data records and original output classes, wherein:
i. each training data record is obtained by excluding from a corresponding data record at least the output variable, and
ii. an original output class corresponding to a value of the output variable of the corresponding data record is associated to the training data record;
b. applying, by the computing device, a classification method to the training data set, to generate a classification model associating a predicted output class to the training data record, wherein the predicted output class is selected from the original output classes associated to the training data records; and
c. comparing, by the computing device, the original output class and the predicted output class, wherein an anomalous data record is detected in a presence of a discrepancy between the original output class and the predicted output class.

### Claim 2 (depends on 1)

The method of claim 1, further comprising assigning a confidence score to the predicted output class by the classification model, wherein the anomalous data record is detected based on a threshold of the confidence score.

### Claim 3 (depends on 2)

The method of claim 2, wherein the predicted output class is the output class which optimizes a probability score assigned to each output class by the classification model.

### Claim 4 (depends on 3)

The method of claim 3, wherein the confidence score of the predicted output class is assigned based on the probability scores associated to the output classes.

### Claim 5 (depends on 1)

The method of claim 1, further comprising submitting the anomalous data record to a validation step, to generate a corrected data set.

### Claim 6 (depends on 1)

The method of claim 1, wherein the classification model is in a form of a set of conditional rules of input variables.

### Claim 7 (depends on 6)

The method of claim 6, wherein the classification method is based on Boolean functions synthesis, said method comprising:
a. converting the training data records into binary strings of a Boolean space by a coding that preserves ordering and distance;
b. generating at least one cluster, the cluster comprising binary strings covered by an implicant, wherein the corresponding training data records are associated to the same output class; and
c. from the implicant, generating a conditional rule.

### Claim 8 (depends on 7)

The method of claim 7, wherein the coding is inverse only-one coding.

### Claim 9 (depends on 7)

The method of claim 7, wherein the implicant is generated by a Shadow Clustering algorithm.

### Claim 10 (depends on 7)

The method of claim 7, further comprising assigning one or more significance parameters to each conditional rule, wherein probability scores are assigned based on the significance parameters of the conditional rules satisfied by the training data record.

### Claim 11 (depends on 7)

The method of claim 7, wherein a validation step of the anomalous data record is performed by or under supervision of a human operator based on the conditional rules verified by the anomalous data record.

### Claim 12 (depends on 1)

The method of claim 1, wherein the input variables are related to at least one category selected from the group comprising names, codes, time values, address components, control parameters, and numeric values.

### Claim 13 (depends on 1)

The method of claim 1, wherein the data records of the unlabeled data set are related to an application selected from the group comprising: auto insurance damage claims, a business process, a medical patient records, a purchase order, and a supply chain management.

### Claim 14 (depends on 1)

The method of claim 1, wherein the method is integrated in a business or operations software application selected from the group comprising: enterprise resource planning (ERP), customer relationship management (CRM), product lifecycle management (PLM), and electronic health records management (EHRM).

### Claim 15

An apparatus comprising:
a processor; and
memory storing computer-executable instructions that, when executed by the processor, cause the apparatus to:
from an unlabeled data set comprising data records of input variables and at least one output variable dependent from one or more input variables, generate a training data set comprising training data records and original output classes, wherein:
each training data record is obtained by excluding from a corresponding data record at least the output variable, and
an original output class corresponding to a value of the output variable of the corresponding data record is associated to the training data record;
apply a classification method to the training data set, to generate a classification model associating a predicted output class to the training data record, wherein the predicted output class is selected from the original output classes associated to the training data records; and
compare the original output class and the predicted output class, wherein an anomalous data record is detected in a presence of a discrepancy between the original output class and the predicted output class.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the computer-readable instructions, when executed by the processor, further cause the apparatus to:
assign a confidence score to the predicted output class by the classification model, wherein the anomalous data record is detected based on a threshold of the confidence score.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the predicted output class is the output class which optimizes a probability score assigned to each output class by the classification model.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein the confidence score of the predicted output class is assigned based on the probability scores associated to the output classes.

### Claim 19 (depends on 15)

The apparatus of claim 15, wherein the computer-readable instructions, when executed by the apparatus, cause the apparatus to:
submit the anomalous data record to a validation step, to generate a corrected data set.

### Claim 20 (depends on 15)

The apparatus of claim 15, wherein the classification model is in a form of a set of conditional rules of input variables.
