# US 2025/0156771 A1 · Methods and systems for generating predictions based on time series data using an ensemble modeling

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0156771 A1
- Document ID: US20250156771A1
- Status: Published application
- Kind: A1
- Application number: 18/929,019
- Filed: 2024-10-28
- Published: 2025-05-15
- Earliest claimed: 2021-03-18
- Assignees: The Bank of New York Mellon
- Applicants: The Bank of New York Mellon
- Inventors: Hongshan GUO; Yu YU; Sahil GOEL; Lin WANG
- Web page: https://patentgrep.com/patent/US20250156771A1

## CPC

- G06N 20/20: Ensemble learning
- G06F 17/18: for evaluating statistical data {, e.g. average values, frequency distributions, probability functions, regression analysis (forecasting specially adapted for a specific administrative, business or logistic context G06Q10/04)}
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06Q 10/04: Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem" (market predictions or forecasting for commercial activities G06Q30/0202)
- G06Q 30/0201: Market modelling; Market analysis; Collecting market data
- G06Q 30/0202: Market predictions or forecasting for commercial activities
- G06Q 50/06: Energy or water supply
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

The methods and systems provide an ensemble approach that combines multiple single-model-solutions to produce optimal forward-looking forecasts. Moreover, the methods and systems provide an architecture for this ensemble approach that ensures that the limitations for individual ensemble model components are compensated by other ensemble model components as inputs and outputs from ensemble model components are fed from one ensemble model component to another in a specific order to generate a final output upon which a conservative prediction is based.

## Claims

### Claim 1

A system for using an ensemble machine learning model to generate predictions based on time series data, the system comprising:
cloud-based storage circuitry configured to store the ensemble machine learning model, wherein the ensemble machine learning model is trained on a plurality of samples of time series data, wherein the plurality of samples of time series data is generated based on cross-validation resampling;
control circuitry configured to:
receive a first feature input, wherein the first feature input represents a first set of times series data;
input the first feature input into a first ensemble model component and a second ensemble model component;
receive a first output from the first ensemble model component and a second output from the second ensemble model component;
generate a second feature input based on the first output and the second output, wherein generating the second feature input based on the first output and the second output further comprises:
generating a plurality of respective outputs from a plurality of ensemble model components, wherein respective inputs for the plurality of ensemble model components comprise the first output or the second output; and
determining the second feature input based on the respective outputs;
input the second feature input into a final ensemble model component to determine a final output, wherein the final ensemble model component comprises the plurality of ensemble model components used to generate predictions subject to a constraint comprising imposing an upper bound on over-estimation frequency and an upper bound on a maximum over-estimation value; and
input/output circuitry configured to generate for display, on a user interface, a prediction based on the final output.

### Claim 2

A method for using an ensemble machine learning model to generate predictions based on time series data, the method comprising:
receiving a first feature input, wherein the first feature input represents a first set of times series data;
inputting the first feature input into a first ensemble model component and a second ensemble model component;
receiving a first output from the first ensemble model component and a second output from the second ensemble model component;
generating a second feature input based on the first output and the second output;
inputting the second feature input into a final ensemble model component to determine a final output, wherein the final ensemble model component comprises a plurality of ensemble model components used to generate predictions subject to a constraint comprising imposing an upper bound on over-estimation frequency and an upper bound on a maximum overestimation value; and
generating for display, on a user interface, a prediction based on the final output.

### Claim 3 (depends on 2)

The method of claim 2, wherein the first output is based on a point estimate based on the first feature input, and wherein the second output is based on a lower tail distribution of a quantile regression.

### Claim 4 (depends on 2)

The method of claim 2, wherein generating the predictions subject to the constraint comprises minimizing a loss function while imposing a penalty for overestimation.

### Claim 5 (depends on 2)

The method of claim 2, further comprising:
determining respective weights for each of the plurality of ensemble model components; and
applying the respective weights to the final ensemble model component as parameters.

### Claim 6

(canceled)

### Claim 7 (depends on 2)

The method of claim 2, wherein generating the second feature input based on the first output and the second output further comprises:
generating, based on the first output, a third feature input and a fourth feature input;
inputting the third feature input into a third ensemble model component to determine a third output, wherein the third ensemble model component determines a downward shift for a point estimate, and wherein the downward shift is subject to a floor; and
inputting the fourth feature input into a fourth ensemble model component to determine a fourth output, wherein the fourth ensemble model component determines a standard deviation for past values of the point estimate.

### Claim 8 (depends on 7)

The method of claim 7, wherein generating the second feature input based on the first output and the second output further comprises:
generating, based on the second output, a fifth feature input; and
inputting the fifth feature input into a fifth ensemble model component to determine a fifth output, wherein the fifth ensemble model component performs a quantile regression.

### Claim 9 (depends on 2)

The method of claim 2, wherein generating the second feature input based on the first output and the second output further comprises:
generating a plurality of respective outputs from the plurality of ensemble model components, wherein respective inputs for the plurality of ensemble model components comprise the first output or the second output; and
determining the second feature input based on the respective outputs.

### Claim 10 (depends on 2)

The method of claim 2, wherein the constraint is measured by minimizing a loss function based on mean absolute error or root mean squared error.

### Claim 11 (depends on 2)

The method of claim 2, further comprising:
receiving a second feature input, wherein the second feature input represents a second set of time series data;
generating a plurality of samples based on cross-validation resampling of the second set of time series data; and
training the ensemble machine learning model based on the plurality of samples.

### Claim 12

A non-transitory, computer-readable medium for generating hierarchical data structures based on crowdsourced data featuring non-homogenous metadata, comprising instructions that, when executed by one or more processors, cause operations comprising:
receiving a first feature input, wherein the first feature input represents a first set of times series data;
inputting the first feature input into a first ensemble model component and a second ensemble model component;
receiving a first output from the first ensemble model component and a second output from the second ensemble model component;
generating a second feature input based on the first output and the second output;
inputting the second feature input into a final ensemble model component to determine a final output, wherein the final ensemble model component comprises a plurality of ensemble model components used to generate predictions subject to a constraint comprising imposing an upper bound on over-estimation frequency and an upper bound on a maximum overestimation value; and
generating for display, on a user interface, a prediction based on the final output.

### Claim 13 (depends on 12)

The non-transitory, computer-readable medium of claim 12, wherein the first output is based on a point estimate based on the first feature input, and wherein the second output is based on a lower tail distribution of a quantile regression.

### Claim 14 (depends on 12)

The non-transitory, computer-readable medium of claim 12, wherein generating the predictions subject to the constraint comprises minimizing a loss function while imposing a penalty for overestimation.

### Claim 15 (depends on 12)

The non-transitory, computer-readable medium of claim 12, further comprising:
determining respective weights for each of the plurality of ensemble model components; and
applying the respective weights to the final ensemble model component as parameters.

### Claim 16

(canceled)

### Claim 17 (depends on 12)

The non-transitory, computer-readable medium of claim 12, wherein generating the second feature input based on the first output and the second output further comprises:
generating, based on the first output, a third feature input and a fourth feature input;
inputting the third feature input into a third ensemble model component to determine a third output, wherein the third ensemble model component determines a downward shift for a point estimate, and wherein the downward shift is subject to a floor; and
inputting the fourth feature input into a fourth ensemble model component to determine a fourth output, wherein the fourth ensemble model component determines a standard deviation for past values of the point estimate.

### Claim 18 (depends on 17)

The non-transitory, computer-readable medium of claim 17, wherein generating the second feature input based on the first output and the second output further comprises:
generating, based on the second output, a fifth feature input; and
inputting the fifth feature input into a fifth ensemble model component to determine a fifth output, wherein the fifth ensemble model component performs a quantile regression.

### Claim 19 (depends on 12)

The non-transitory, computer-readable medium of claim 12, wherein generating the second feature input based on the first output and the second output further comprises:
generating a plurality of respective outputs from the plurality of ensemble model components, wherein respective inputs for the plurality of ensemble model components comprise the first output or the second output; and
determining the second feature input based on the respective outputs.

### Claim 20 (depends on 12)

The non-transitory, computer-readable medium of claim 12, wherein the constraint is measured by minimizing a loss function based on mean absolute error or root mean squared error.

### Claim 21 (depends on 1)

The system of claim 1, wherein the first output is based on a point estimate based on the first feature input, and wherein the second output is based on a lower tail distribution of a quantile regression.

### Claim 22 (depends on 1)

The system of claim 1, wherein the first ensemble model component is a mean-based regression model, and wherein the second ensemble model component is a quantile regression model.

### Claim 23 (depends on 2)

The method of claim 2, wherein the first ensemble model component is a mean-based regression model, and wherein the second ensemble model component is a quantile regression model.

### Claim 24 (depends on 17)

The non-transitory, computer-readable medium of claim 17, wherein the first ensemble model component is a mean-based regression model, and wherein the second ensemble model component is a quantile regression model.
