# US 2026/0220014 A1 · Benchmarking and segment-based prediction of artificial intelligence model inference characteristics on local devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0220014 A1
- Document ID: US20260220014A1
- Status: Published application
- Kind: A1
- Application number: 19/036,323
- Filed: 2025-01-24
- Published: 2026-07-30
- Earliest claimed: 2025-01-24
- Assignees: Dell Products L.P.
- Applicants: Dell Products L.P.
- Inventors: Spencer Bull; Tyler Cox; Jacob Mink; Srikanth Kondapi
- Web page: https://patentgrep.com/patent/US20260220014A1

## CPC

- G06F 11/3428: {Benchmarking}
- G06F 11/3433: {for load management (allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029)}
- G06F 11/3457: {Performance evaluation by simulation}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An information handling system receives a request for an artificial intelligence service that is associated with an artificial intelligence model and retrieves a manifest associated with the artificial intelligence model. The system also determines a current system capacity of the information handling system and determines a workload segmentation according to the manifest based on the current system capacity of the information handling system.

## Claims

### Claim 1

A method comprising:
receiving, by an information handling system, a request for an artificial intelligence service that is associated with an artificial intelligence model;
retrieving a manifest associated with the artificial intelligence model;
determining a current system capacity of the information handling system; and
determining a workload segmentation according to the manifest based on the current system capacity of the information handling system.

### Claim 2 (depends on 1)

The method of claim 1, wherein the artificial intelligence service is an artificial intelligence model inference.

### Claim 3 (depends on 1)

The method of claim 1, wherein the manifest includes workload performance data based on a benchmarking process.

### Claim 4 (depends on 3)

The method of claim 3, wherein the benchmarking process includes emulation of various combinations of system configuration and system capacity.

### Claim 5 (depends on 1)

The method of claim 1, wherein the manifest is embedded in a model runtime plugin.

### Claim 6 (depends on 1)

The method of claim 1, wherein the artificial intelligence service is executed based on the workload segmentation.

### Claim 7 (depends on 1)

The method of claim 1, wherein the workload segmentation is further based on system configuration.

### Claim 8

An information handling system, comprising:
a processor; and
a memory coupled to the processor, the memory having program instructions stored thereon that upon execution cause the processor to:
receive a request for an artificial intelligence service that is associated with an artificial intelligence model;
retrieve a manifest associated with the artificial intelligence model;
determine a current system capacity of the information handling system; and
determine a workload segmentation according to the manifest based on the current system capacity of the information handling system.

### Claim 9 (depends on 8)

The information handling system of claim 8, wherein the artificial intelligence service is an artificial intelligence model inference.

### Claim 10 (depends on 8)

The information handling system of claim 8, wherein the manifest includes workload performance data based on a benchmarking process.

### Claim 11 (depends on 10)

The information handling system of claim 10, wherein the benchmarking process includes emulation of various combinations of system configuration and system capacity.

### Claim 12 (depends on 8)

The information handling system of claim 8, wherein the manifest is embedded in a model runtime plugin.

### Claim 13 (depends on 8)

The information handling system of claim 8, wherein the workload segmentation is further based on system configuration.

### Claim 14

A non-transitory computer-readable medium to store instructions that are executable to perform operations comprising:
receiving a request at an information handling system for an artificial intelligence service that is associated with an artificial intelligence model;
retrieving a manifest associated with the artificial intelligence model;
determining a current system capacity of the information handling system; and
determining a workload segmentation according to the manifest based on the current system capacity of the information handling system.

### Claim 15 (depends on 14)

The non-transitory computer-readable medium of claim 14, wherein the artificial intelligence service is an artificial intelligence model inference.

### Claim 16 (depends on 14)

The non-transitory computer-readable medium of claim 14, wherein the manifest includes workload performance data based on a benchmarking process.

### Claim 17 (depends on 16)

The non-transitory computer-readable medium of claim 16, wherein the benchmarking process includes emulation of various combinations of system configuration and system capacity.

### Claim 18 (depends on 14)

The non-transitory computer-readable medium of claim 14, wherein the manifest is embedded in a model runtime plugin.

### Claim 19 (depends on 14)

The non-transitory computer-readable medium of claim 14, wherein the artificial intelligence service is executed based on the workload segmentation.

### Claim 20 (depends on 14)

The non-transitory computer-readable medium of claim 14, wherein the workload segmentation is further based on system configuration.
