# US 2023/0410143 A1 · Detecting anomalies in live marketing campaign data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410143 A1
- Document ID: US20230410143A1
- Status: Published application
- Kind: A1
- Application number: 17/830,851
- Filed: 2022-06-02
- Published: 2023-12-21
- Earliest claimed: 2022-05-31
- Assignees: Oracle International Corporation
- Applicants: Oracle International Corporation
- Inventors: Paul Deepakraj Retinraj; Sanjana Arun; Roma Khimani; Saurabh Surendra Shastri
- Web page: https://patentgrep.com/patent/US20230410143A1

## CPC

- G06Q 30/0244: {Optimization}
- G06Q 30/0243: {Comparative campaigns}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Techniques for detecting anomalies in live marketing campaign data are disclosed, including: obtaining baseline data associated with one or more digital marketing campaigns; configuring an anomaly detection model to detect anomalies in digital marketing data, based at least on the baseline data; receiving a live stream of a set of digital marketing data associated with a particular digital marketing campaign that is currently being executed; while the particular digital marketing campaign is being executed: applying the anomaly detection model to the set of digital marketing data, to determine if the set of digital marketing data includes an anomaly relative to the baseline data; prior to completion of the particular digital marketing campaign and responsive to determining that the set of digital marketing data includes the anomaly relative to the baseline data, executing an action to address the anomaly.

## Claims

### Claim 1

One or more non-transitory machine-readable media storing instructions that, when executed by one or more processors, cause performance of operations comprising:
obtaining baseline data associated with one or more digital marketing campaigns;
configuring an anomaly detection model to detect anomalies in digital marketing data, based at least on the baseline data;
receiving a live stream of a set of digital marketing data associated with a particular digital marketing campaign that is currently being executed;
while the particular digital marketing campaign is being executed: applying the anomaly detection model to the set of digital marketing data, to determine if the set of digital marketing data comprises an anomaly relative to the baseline data;
prior to completion of the particular digital marketing campaign and responsive to determining that the set of digital marketing data comprises the anomaly relative to the baseline data, executing an action to address the anomaly.

### Claim 2 (depends on 1)

The one or more non-transitory machine-readable media of claim 1, wherein:
obtaining the baseline data comprises obtaining prior digital marketing data associated with the particular digital marketing campaign; and
wherein obtaining the baseline data comprises:
training a machine learning model to determine one or more baseline performance metrics for digital marketing campaigns;
applying the machine learning model to the prior digital marketing data associated with the particular digital marketing campaign, to obtain the one or more baseline performance metrics for the particular digital marketing campaign.

### Claim 3 (depends on 1)

The one or more non-transitory machine-readable media of claim 1, wherein executing the action to address the anomaly comprises one or more of modifying or terminating the particular digital marketing campaign.

### Claim 4 (depends on 1)

The one or more non-transitory machine-readable media of claim 1, wherein the live stream of the set of digital marketing data comprises data indicating one or more performance metrics associated with the particular digital marketing campaign.

### Claim 5 (depends on 1)

The one or more non-transitory machine-readable media of claim 1, wherein obtaining the baseline data comprises receiving a plurality of sets of digital marketing data associated, respectively, with a plurality of digital marketing campaigns, wherein at least two digital marketing campaigns in the plurality of digital marketing campaigns are associated with different tenants of a multi-tenant digital marketing platform.

### Claim 6 (depends on 5)

The one or more non-transitory machine-readable media of claim 5, wherein obtaining the baseline data further comprises determining one or more baseline campaign performance metrics, based at least on the digital marketing data associated with the plurality of digital marketing campaigns.

### Claim 7 (depends on 5)

The one or more non-transitory machine-readable media of claim 5, the operations further comprising:
selecting the plurality of digital marketing campaigns from a plurality of available digital marketing campaigns, based at least on one or more campaign selection criteria.

### Claim 8 (depends on 7)

The one or more non-transitory machine-readable media of claim 7, wherein selecting the plurality of digital marketing campaigns from the plurality of available digital marketing campaigns comprises:
training a machine learning model to identify similarities between digital marketing campaigns;
applying the machine learning model to the available digital marketing campaigns, to select the plurality of digital marketing campaigns.

### Claim 9 (depends on 1)

The one or more non-transitory machine-readable media of claim 1, wherein obtaining the baseline data comprises obtaining a baseline data schema for digital marketing data associated with the particular digital marketing campaign.

### Claim 10 (depends on 1)

The one or more non-transitory machine-readable media of claim 1, wherein obtaining the baseline data comprises obtaining one or more user-defined baseline campaign performance metrics.

### Claim 11 (depends on 1)

The one or more non-transitory machine-readable media of claim 1, wherein:
configuring the anomaly detection model comprises training a machine learning model to detect anomalies in digital marketing data, using the baseline data as training data;
applying the anomaly detection model to the set of digital marketing data comprises applying the machine learning model to the set of digital marketing data.

### Claim 12 (depends on 11)

The one or more non-transitory machine-readable media of claim 11, the operations further comprising:
updating the machine learning model based at least on the anomaly.

### Claim 13 (depends on 1)

The one or more non-transitory machine-readable media of claim 1, wherein configuring the anomaly detection model comprises configuring a set of one or more anomaly detection rules, based at least on the baseline data.

### Claim 14 (depends on 1)

The one or more non-transitory machine-readable media of claim 1, the operations further comprising:
generating an anomaly score associated with the anomaly;
performing a comparison of the anomaly score with at least one predetermined threshold value;
determining, based at least on the comparison of the anomaly score with the at least one predetermined threshold value, a severity of the anomaly.

### Claim 15 (depends on 14)

The one or more non-transitory machine-readable media of claim 14, wherein the severity of the anomaly indicates that the anomaly is a good anomaly.

### Claim 16 (depends on 14)

The one or more non-transitory machine-readable media of claim 14, the operations further comprising:
based at least on the anomaly score, determining successfulness of the digital marketing campaign.

### Claim 17 (depends on 1)

The one or more non-transitory machine-readable media of claim 1, the operations further comprising:
presenting, in a graphical user interface, information that describes the action to address the anomaly;
receiving, via the graphical user interface, a user instruction to execute the action;
wherein executing the action to address the anomaly is performed responsive to receiving the user instruction.

### Claim 18 (depends on 1)

The one or more non-transitory machine-readable media of claim 1, the operations further comprising:
based at least on the anomaly, determining a micro-segmentation of a prospective customer base such that members of the prospective customer base who belong to the micro-segmentation tend to be more strongly associated with the anomaly than members of the prospective customer base who do not belong to the micro-segmentation.

### Claim 19

A system comprising:
at least one device comprising one or more hardware processors,
the system being configured to perform operations comprising:
obtaining baseline data associated with one or more digital marketing campaigns;
configuring an anomaly detection model to detect anomalies in digital marketing data, based at least on the baseline data;
receiving a live stream of a set of digital marketing data associated with a particular digital marketing campaign that is currently being executed;
while the particular digital marketing campaign is being executed: applying the anomaly detection model to the set of digital marketing data, to determine if the set of digital marketing data comprises an anomaly relative to the baseline data;
prior to completion of the particular digital marketing campaign and responsive to determining that the set of digital marketing data comprises the anomaly relative to the baseline data, executing an action to address the anomaly.

### Claim 20

A method comprising:
obtaining baseline data associated with one or more digital marketing campaigns;
configuring an anomaly detection model to detect anomalies in digital marketing data, based at least on the baseline data;
receiving a live stream of a set of digital marketing data associated with a particular digital marketing campaign that is currently being executed;
while the particular digital marketing campaign is being executed: applying the anomaly detection model to the set of digital marketing data, to determine if the set of digital marketing data comprises an anomaly relative to the baseline data;
prior to completion of the particular digital marketing campaign and responsive to determining that the set of digital marketing data comprises the anomaly relative to the baseline data, executing an action to address the anomaly,
wherein the method is performed by at least device comprising one or more hardware processors.
