# US 2026/0065357 A1 · Selective data rejection for computationally efficient distributed analytics platform

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065357 A1
- Document ID: US20260065357A1
- Status: Published application
- Kind: A1
- Application number: 19/377,185
- Filed: 2025-11-03
- Published: 2026-03-05
- Earliest claimed: 2019-06-30
- Assignees: Charles Schwab & Co., Inc.
- Applicants: Charles Schwab & Co., Inc.
- Inventors: Aaron Andrew BLOMBERG; Mitchel William WEILER; Alexander Conrad OCKENDEN; Curtis Joseph BEESON
- Web page: https://patentgrep.com/patent/US20260065357A1

## CPC

- G06Q 30/0641: {utilising user interfaces specially adapted for shopping}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 18/211: Selection of the most significant subset of features
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06F 18/217: {Validation; Performance evaluation; Active pattern learning techniques}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06F 18/40: Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
- G06N 5/025: Extracting rules from data
- G06N 20/20: Ensemble learning
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A model management system for validating models for predicting a client behavior event includes a model validation system configured to execute each of multiple stages of a selected model, which includes calculating a respective output based on a respective input of each of the stages. The model validation system is configured to separately verify, based on the respective outputs, each of the stages. The model validation system is configured to generate and store model data corresponding to the respective outputs of each of the stages. The model data includes a first set of model data and a second set of model data different from the first set of model data. A user interface module is configured to receive an indication of credentials of a user and selectively retrieve and display one of the first set of model data and the second set of model data based on the indication.

## Claims

### Claim 1

A model management system for validating models for predicting a client behavior event, the model management system comprising:
a memory having computer readable instructions stored thereon;
at least one processor configured to execute the computer readable instructions to cause the model management system to
select a model of a plurality of models to validate with a model analyzer, the model analyzer including a plurality of sequential stages, each of the plurality of sequential stages having code that is stored in separate containers and executed independently,
separately modify the code corresponding to respective stages of the plurality of sequential stages by accessing a desired container of the separate containers,
input client data and a plurality of variables into a first stage of the plurality of sequential stages,
execute each of the plurality of sequential stages of the model analyzer, wherein executing each of the plurality of sequential stages includes calculating a respective output based on a respective input of each of the plurality of sequential stages, wherein the respective outputs of each of the plurality of sequential stages are provided as the respective inputs to stages subsequent to the first stage of the plurality of sequential stages,
separately verify, based on the respective outputs, each of the plurality of sequential stages by comparing the respective outputs to at least one of a corresponding threshold or range of values,
generate and store model data corresponding to the respective outputs of each of the plurality of sequential stages, wherein the model data includes a first set of model data corresponding to the outputs of each of the plurality of sequential stages and a second set of model data different from the first set of model data, wherein the second set of model data is a subset of the first set of model data; and
a user interface configured to
receive an indication of credentials of a user, and
selectively retrieve and output either the first set of model data or the second set of model data based on the indication.

### Claim 2 (depends on 1)

The model management system of claim 1, wherein the model management system is further caused to generate and transmit a notification in response to the comparing the respective outputs to at least one of the corresponding threshold or the range of values.

### Claim 3 (depends on 2)

The model management system of claim 2, wherein the notification identifies a variable used in a respective one of the plurality of sequential stages.

### Claim 4 (depends on 1)

The model management system of claim 1, wherein the first set of model data is accessible, via the user interface, to a first set of users and the second set of model data is accessible, via the user interface, to a second set of users.

### Claim 5 (depends on 1)

The model management system of claim 1, wherein the model management system is further caused to store output tables including data indicative of the respective outputs of each of the plurality of sequential stages.

### Claim 6 (depends on 5)

The model management system of claim 5, wherein the model management system is further caused to update the model data using the data in the output tables.

### Claim 7 (depends on 6)

The model management system of claim 6, wherein the model data includes a visual representation of the data in the output tables.

### Claim 8 (depends on 1)

The model management system of claim 1, wherein the user interface is configured to selectively display one of a model performance interface accessible by a first set of users and a storefront interface accessible by a second set of users.

### Claim 9 (depends on 1)

The model management system of claim 1, wherein the comparing the respective outputs to at least one of the corresponding threshold or the range of values for each stage of the plurality of sequential stages indicates whether the model failed at the respective stage of the plurality of sequential stages.

### Claim 10 (depends on 1)

The model management system of claim 1, wherein the model management system is further caused to
selectively stop executing the plurality of sequential stages of the model analyzer based on the comparing the respective outputs to at least one of the corresponding threshold or the range of values indicating the model failed at the respective stage of the plurality of sequential stages; and
re-execute the respective stage of the plurality of sequential stages in response to receiving a request to re-execute the respective stage of the plurality of sequential stages via the user interface.

### Claim 11

A method for validating models for predicting a client behavior event, the method comprising:
selecting a model of a plurality of models to validate with a model analyzer, the model analyzer including a plurality of sequential stages, each of the plurality of sequential stages having code that is stored in separate containers and executed independently;
separately modifying the code corresponding to respective stages of the plurality of sequential stages by accessing a desired container of the separate containers;
inputting client data and a plurality of variables into a first stage of the plurality of sequential stages;
executing each of the plurality of sequential stages of the model analyzer, wherein executing each of the plurality of sequential stages includes calculating a respective output based on a respective input of each of the plurality of sequential stages, wherein the respective outputs of each of the plurality of sequential stages are provided as the respective inputs to stages subsequent to the first stage of the plurality of sequential stages;
separately verifying, based on the respective outputs, each of the plurality of sequential stages by comparing the respective outputs to at least one of a corresponding threshold or range of values;
generating and storing model data corresponding to the respective outputs of each of the plurality of sequential stages, wherein the model data includes a first set of model data corresponding to the outputs of each of the plurality of sequential stages and a second set of model data different from the first set of model data, wherein the second set of model data is a subset of the first set of model data;
receiving an indication of credentials of a user; and
selectively retrieving and displaying on a user interface either the first set of model data or the second set of model data based on the indication.

### Claim 12 (depends on 11)

The method of claim 11, further comprising generating and transmitting a notification in response to the comparing the respective outputs to at least one of the corresponding threshold or the range of values.

### Claim 13 (depends on 12)

The method of claim 12, wherein the notification identifies a variable used in a respective one of the plurality of sequential stages.

### Claim 14 (depends on 11)

The method of claim 11, wherein the first set of model data is accessible, via a user interface module, to a first set of users and the second set of model data is accessible, via a user interface module, to a second set of users.

### Claim 15 (depends on 11)

The method of claim 11, further comprising storing output tables including data indicative of the respective outputs of each of the plurality of sequential stages.

### Claim 16 (depends on 15)

The method of claim 15, further comprising updating the model data based on the output tables.

### Claim 17 (depends on 16)

The method of claim 16, wherein the model data includes a visual representation of the data in the output tables.

### Claim 18 (depends on 11)

The method of claim 11, wherein the user interface is configured to selectively display one of a model performance interface accessible by a first set of users and a storefront interface accessible by a second set of users.

### Claim 19 (depends on 11)

The method of claim 11, wherein the comparing the respective outputs to at least one of the corresponding threshold or the range of values for each stage of the plurality of sequential stages indicates whether the model failed at the respective stage of the plurality of sequential stages.

### Claim 20 (depends on 11)

The method of claim 11, further comprising:
selectively stopping executing the plurality of sequential stages of the model analyzer based on the comparing the respective outputs to at least one of the corresponding threshold or the range of values indicating the model failed at the respective stage of the plurality of sequential stages; and
re-executing the respective stage of the plurality of sequential stages in response to receiving a request to re-execute the respective stage of the plurality of sequential stages via the user interface.
