# US 2023/0267499 A1 · Approaches to predicting the impact of marketing campaigns with artificial intelligence and computer programs for implementing the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0267499 A1
- Document ID: US20230267499A1
- Status: Published application
- Kind: A1
- Application number: 18/172,634
- Filed: 2023-02-22
- Published: 2023-08-24
- Earliest claimed: 2022-02-24
- Assignees: Tickr, Inc.
- Applicants: Tickr, Inc.
- Inventors: Samuel Henry KAHN; Timothy John WILLIAMS
- Web page: https://patentgrep.com/patent/US20230267499A1

## CPC

- G06Q 30/0242: Determining effectiveness of advertisements
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 20/00: Machine learning
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

One of the most challenging problems that marketing professionals face is measuring the effect of advertising campaigns on the sales of a product. One of the main causes of poorly allocated spend is incorrect analysis of advertising campaign effectiveness. Introduced here is an approach to determining advertising campaign effectiveness in a more accurate, dependable manner using machine learning to extract the true effect of an advertising. This approach can be implemented by a data analysis platform that is able to train a machine learning algorithm using company-specific data as part of a training operation, as well as implementing the resulting machine learning model as part of an inferencing operation.

## Claims

### Claim 1

A non-transitory medium with instructions stored thereon that, when executed by a processor of a computing device, cause the computing device to perform operations comprising:
obtaining a dataset that includes a series of values, in temporal order, that are indicative of performance of a company over an interval of time;
segmenting the dataset into—
(i) a first dataset corresponding to a first period of time preceding an introduction of an advertising campaign, wherein the first period of time is representative of a subset of the interval of time, and
(ii) a second dataset corresponding to a second period of time over which the advertising campaign occurs, wherein the second period of time is representative of another subset of the interval of time;
training a machine learning algorithm with the first dataset, so as to produce a machine learning model that is able to predict performance of the company in the absence of the advertising campaign;
applying the machine learning model to the second dataset, so as to produce a third dataset that is indicative of predicted performance during the second period of time in the absence of the advertising campaign; and
causing digital presentation of the second and third datasets on an interface as separate traces, so as to visually and programmatically indicate a difference between performance of the company with the advertising campaign and predicted performance of the company without the advertising campaign.

### Claim 2 (depends on 1)

The non-transitory medium of claim 1, wherein the interface also includes the first dataset that is presented as a trace.

### Claim 3 (depends on 1)

The non-transitory medium of claim 1, wherein the operations further comprise:
tuning the machine learning model for the company in an autonomous manner using a statistical modeling technique.

### Claim 4 (depends on 3)

The non-transitory medium of claim 3, wherein the statistical modeling technique is a Bayesian structural time series.

### Claim 5 (depends on 1)

The non-transitory medium of claim 1, wherein the machine learning model includes one or more state variables that, as part of an inferencing operation, are summed in a weighted manner to establish predicted performance.

### Claim 6 (depends on 5)

The non-transitory medium of claim 5,
wherein the machine learning model includes separate state variables for trend, seasonality, and regression, and
wherein for each state variable, a corresponding weight is learned through analysis of the first dataset provided to the machine learning algorithm for training purposes.

### Claim 7 (depends on 1)

The non-transitory medium of claim 1, wherein the operations further comprise:
employing a Monte Carlo algorithm to find a posterior distribution of an output produced by the machine learning model upon being applied to the second dataset,
wherein the Monte Carlo algorithm produces, as output, a sequence of random samples; and
using the sequence of random samples to estimate integrals with respect to a target distribution, thereby computing expected values for a key performance indicator by which performance is measured.

### Claim 8 (depends on 7)

The non-transitory medium of claim 7, wherein the key performance indicator is sales, revenue, virality, relevance, or traffic.

### Claim 9

A method performed by a computer program executing on a computing device, the method comprising:
training a machine learning algorithm with a first dataset that includes a first series of values, in temporal order, that are indicative of performance of a company over a first interval of time that precedes an advertising campaign, so as to produce a machine learning model;
applying the machine learning model to a second dataset that includes a second series of values, in temporal order, that are indicative of performance of the company over a second interval of time over which the advertising campaign occurs, so as to produce an output;
applying a Monte Carlo algorithm to the output produced by the machine learning model to obtain a series of random samples distributed across a target probability distribution;
estimating, based on the series of random samples, integrals with respect to the target probability distribution, thereby computing expected values for a key performance indicator by which performance of the company is measured.

### Claim 10 (depends on 9)

The method of claim 9, wherein the target probability distribution corresponds to the second interval of time.

### Claim 11 (depends on 9)

The method of claim 9, wherein the Monte Carlo algorithm is based on a Markov chain Monte Carlo approach to sampling from the target probability distribution.

### Claim 12 (depends on 9)

The method of claim 9, wherein the machine learning model includes one or more state variables that, as part of an inferencing operation, are summed in a weighted manner to establish predicted performance

### Claim 13 (depends on 12)

The method of claim 12, wherein for each state variable, a corresponding weight is learned through analysis of the first dataset provided to the machine learning algorithm as part of a training operation, in which a spike-and-slab prior is used for each state variable to allow the machine learning model to regularize and perform feature selection.

### Claim 14 (depends on 13)

The method of claim 13, wherein for each state variable, a corresponding spike-and-slab prior is representative of a generative model in which that state variable either attains a fixed value or is drawn toward another value.

### Claim 15 (depends on 9)

The method of claim 9, further comprising:
receiving input that is indicative of a selection, made by a user through an interface, of the first and second datasets or another dataset of which the first and second datasets are a part; and
obtaining, in response to said receiving, the first and second datasets or the other dataset.

### Claim 16 (depends on 15)

The method of claim 15, wherein the first and second datasets or the other dataset are acquired via a Representational State Transfer (REST) application programming interface (API) or a database connector.

### Claim 17 (depends on 9)

The method of claim 9, further comprising:
causing digital presentation of an interface through which a user is able to directly upload one or more files that include the first and second datasets.

### Claim 18 (depends on 17)

The method of claim 17, wherein the one or more files are comma-separated value (CSV) files or spreadsheet files.
