# US 2003/0200134 A1 · System and method for large-scale automatic forecasting

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2003/0200134 A1
- Document ID: US20030200134A1
- Status: Published application
- Kind: A1
- Application number: 10/402,849
- Filed: 2003-03-28
- Published: 2003-10-23
- Earliest claimed: 2002-03-29
- Inventors: Michael James Leonard; David Bruce Elsheimer
- Web page: https://patentgrep.com/patent/US20030200134A1

## CPC

- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- G06Q 30/0202: Market predictions or forecasting for commercial activities
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

A computer-implemented method and system for large-scale automatic forecasting. The method and system determine which forecasting models in a pool of forecasting models may best predict input transactional data. Candidate models are selected from the pool of forecasting models by comparing characteristics of the models in the pool with characteristics of the input transaction data. To further reduce the number of models, hold-out sample analysis is performed for the candidate models. The candidate model(s) that best perform with respect to the hold-out sample analysis are used to generate forecasted output.

## Claims

### Claim 1

A computer-implemented method for automatically selecting forecasting models, comprising the steps of:
receiving a pool of forecasting models, wherein the forecasting models in the pool have at least one pre-identified model characteristic;
receiving time series data indicative of transactional activity;
determining at least one statistical characteristic of the time series data;
comparing the determined statistical characteristic of the time series data with the pre-identified model characteristic of the forecasting models in the pool to identify candidate forecasting models;
determining a data subset from the time series data and a hold-out sample from the time series data;
optimizing at least one parameter of the candidate forecasting models using the time series data subset;
calculating statistics-of-fit for the candidate forecasting models using the hold-out sample; and
selecting at least one of the candidate forecasting models based upon the calculated statistics-of-fit of the candidate forecasting models.

### Claim 2 (depends on 1)

The method of claim 1, wherein the time series data includes data representative of operating a physical system over a period of time.

### Claim 3 (depends on 2)

The method of claim 2, wherein the physical system is a manufacturing system.

### Claim 4 (depends on 2)

The method of claim 2, wherein the physical system is a system selected from the group consisting of a grocery store chain, a retail store chain, and combinations thereof.

### Claim 5 (depends on 1)

The method of claim 1, further comprising the step of:
optimizing at least one parameter of the selected candidate forecasting model using substantially all of the time series data.

### Claim 6 (depends on 1)

The method of claim 1, further comprising the step of:
generating a forecasted output using the selected candidate forecasting model.

### Claim 7 (depends on 6)

The method of claim 6, wherein the forecasted output includes a prediction, an upper confidence limit, and a lower confidence limit.

### Claim 8 (depends on 1)

The method of claim 1, wherein the time series data is accumulated from a file of transactional data using at least one pre-selected parameter.

### Claim 9 (depends on 8)

The method of claim 8, wherein the pre-selected parameters include an accumulation frequency, a seasonal cycle, and an accumulation method.

### Claim 10 (depends on 8)

The method of claim 8, wherein the file of transactional data is accumulated from an Internet website.

### Claim 11 (depends on 8)

The method of claim 8, wherein the file of transactional data is accumulated from a point-of-sale (POS) device.

### Claim 12 (depends on 1)

The method of claim 1, further comprising the step of:
generating a forecasted output for one time period using the selected candidate forecasting model;
receiving additional time series data for the one time period; and
calculating at least one in-sample statistic-of-fit for the selected candidate forecasting model using the forecasted output and the additional time series data.

### Claim 13 (depends on 12)

The method of claim 12, further comprising the step of:
generating an evaluation output that indicates the in-sample statistic-of-fit.

### Claim 14 (depends on 13)

The method of claim 13, further comprising the step of:
selecting a new candidate forecasting model from the pool of forecasting models based on the evaluation output.

### Claim 15 (depends on 1)

The method of claim 1, further comprising the step of:
generating a forecasted output for a plurality of time periods using the selected candidate forecasting model;
receiving additional time series data for the plurality of time periods; and
calculating at least one in-sample statistic-of-fit for the selected candidate forecasting model using the forecasted output and the additional time series data.

### Claim 16 (depends on 15)

The method of claim 15, further comprising the step of:
generating a performance analysis output that indicates the in-sample statistic-of-fit.

### Claim 17 (depends on 16)

The method of claim 16, further comprising the step of:
selecting a new candidate forecasting model from the pool of forecasting models based on the performance analysis output.

### Claim 18 (depends on 1)

The method of claim 1, further comprising the step of:
receiving special event information,
wherein the special event information is incorporated into a candidate forecasting model.

### Claim 19 (depends on 18)

The method of claim 18, wherein the special event information includes at least one special event that occurs during a calendar year and causes deviations to occur within the time series data.

### Claim 20 (depends on 19)

The method of claim 19, wherein the special event occur at a specified time and endures for a specified time period.

### Claim 21 (depends on 1)

The method of claim 1, wherein the time series data includes historical data about one or more past promotions, wherein a candidate forecasting model is selected after taking into account intervention factors.

### Claim 22 (depends on 21)

The method of claim 21, wherein the intervention analysis is used to assess one or more past promotions.

### Claim 23

An automatic forecasting system, comprising:
a pool of forecasting models, wherein each forecasting model has at least one pre-identified model characteristic;
a file containing time series data indicative of transactional activity;
a forecasting model selection module that receives the file of time series data and selects at least one forecasting model from the pool of forecasting models by determining at least one statistical characteristic of the time series data and comparing the statistical characteristic with the pre-identified model characteristic of the forecasting models in the pool; and
a forecasting module coupled to the forecasting model selection module that fits the selected forecasting model to the time series data and generates a forecasted output.

### Claim 24 (depends on 23)

The automatic forecasting system of claim 23, wherein the file of time series data comprises time series data that has been accumulated from a file of transactional data.

### Claim 25 (depends on 23)

The automatic forecasting system of claim 23, wherein the forecasting model selection module comprises:
a diagnostic module that receives a file of time series data, and that determines the statistical characteristic of the time series data and compares the statistical characteristic with the pre-identified model characteristic of each forecasting model to determine candidate forecasting models; and
a selector module coupled to the diagnostic module that calculates a statistic-of fit for each candidate forecasting model, and compares the statistics-of-fit to select the forecasting model.

### Claim 26 (depends on 25)

The automatic forecasting system of claim 25, wherein the statistic-of-fit calculated by the selector module is of a type selected by a system user as a model selection criterion.

### Claim 27 (depends on 25)

The automatic forecasting system of claim 25, wherein the selector module further comprising:
a candidate optimizer module coupled to the diagnostic module that optimizes at least one parameter of the candidate forecasting models using a subset of the time series data; and
a hold-out forecasting module coupled to the candidate optimizer module that calculates a statistic-of-fit for each candidate forecasting model, and that selects the candidate forecasting model based on the statistics-of-fit.

### Claim 28 (depends on 23)

The automatic forecasting system of claim 23, wherein the forecasted output includes one-step ahead forecast data, and further comprising:
an evaluation module that receives the one-step ahead forecast data from the forecasting module and receives a file of actual data corresponding to the one-step ahead forecast data, and that is configured to calculate a statistic-of-fit from the one-step ahead forecast data and the file of actual data.

### Claim 29 (depends on 23)

The automatic forecasting system of claim 23, wherein the forecasted output includes h-step ahead forecast data, and further comprising:
a performance analysis module that receives the h-step ahead forecast data from the forecasting module and receives a file of actual data corresponding to the h-step ahead forecast data, and that is configured to calculate a statistic-of-fit from the h-step ahead forecast data and the file of actual data.

### Claim 30 (depends on 23)

The automatic forecasting system of claim 23, wherein special event information is incorporated into the selected forecasting model.

### Claim 31 (depends on 30)

The automatic forecasting system of claim 30, wherein the special event information includes at least one special event that occurs during a calendar year and causes deviations to occur within the time series data.

### Claim 32 (depends on 31)

The automatic forecasting system of claim 31, wherein the special event occur at a specified time and endures for a specified time period.

### Claim 33 (depends on 23)

The automatic forecasting system of claim 23, wherein the time series data includes historical data about one or more past promotions, wherein a forecasting model is selected after taking into account intervention factors.

### Claim 34 (depends on 33)

The automatic forecasting system of claim 33, wherein the intervention analysis is used to assess one or more past promotions.

### Claim 35

A computer-implemented apparatus for automatically selecting forecasting models, comprising:
means for receiving a pool of forecasting models, wherein the forecasting models in the pool have at least one pre-identified model characteristic;
means for receiving time series data indicative of millions of transactional activities;
means for determining at least one statistical characteristic of the time series data;
means for comparing the determined statistical characteristic of the time series data with the pre-identified model characteristic of the forecasting models in the pool to identify candidate forecasting models;
means for determining a data subset from the time series data and a hold-out sample from the time series data;
means for optimizing for each time series at least one parameter of the candidate forecasting models using the time series data subset;
means for calculating statistics-of-fit for the candidate forecasting models using the hold-out sample; and
means for selecting at least one of the candidate forecasting models based upon the calculated statistics-of-fit of the candidate forecasting models.
