# US 2026/0093952 A1 · Managing inference model consistency

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0093952 A1
- Document ID: US20260093952A1
- Status: Published application
- Kind: A1
- Application number: 18/899,207
- Filed: 2024-09-27
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Assignees: Dell Products L.P.
- Applicants: Dell Products L.P.
- Inventors: OFIR EZRIELEV; JEHUDA SHEMER; ONUR CELEBIOGLU
- Web page: https://patentgrep.com/patent/US20260093952A1

## CPC

- G06N 3/045: Combinations of networks
- G06N 3/0475: Generative networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Methods and systems for managing inference models are disclosed. To do so, a consistency of an inference model hosted by a remote resource may be evaluated using a second inference model hosted by a local resource. Evaluating the consistency of the inference model may include providing a set of prompts to the inference model. The set of prompts may be intended to elicit responses with a same information content. The inference model may generate a set of responses and the second inference model may be prompted to evaluate the set of responses. The second inference model may evaluate a level of agreement between the set of responses and it may be determined whether the set of responses meet criteria. If the set of responses meet the criteria, it may be concluded that the consistency of the inference model is acceptable for use in providing computer-implemented services.

## Claims

### Claim 1

A method for managing an inference model, the method comprising:
obtaining a set of prompts for the inference model, the set of prompts being intended to elicit responses from the inference model that have a same information content;
obtaining, using the set of prompts, a set of responses from the inference model, the set of responses comprising:
a first response to a first prompt of the set of prompts; and
a second response to a second prompt of the set of prompts;
performing, using a second inference model, an agreement testing process to obtain a level of agreement between at least the first response and the second response;
making a determination regarding whether the level of agreement meets criteria;
in a first instance of the determination in which the level of agreement meets the criteria:
concluding that a consistency of the inference model is acceptable; and
in a second instance of the determination in which the level of agreement does not meet the criteria:
concluding that the consistency of the inference model is not acceptable.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
in the first instance of the determination in which the level of agreement meets the criteria:
providing computer-implemented services using the inference model.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
in the second instance of the determination in which the level of agreement does not meet the criteria:
excluding the inference model for provisioning of computer-implemented services.

### Claim 4 (depends on 1)

The method of claim 1, wherein performing the agreement testing process comprises:
prompting the second inference model to compare an information content of at least the first response and the second response; and
obtaining an output from the second inference model, the output being usable to obtain the level of agreement.

### Claim 5 (depends on 4)

The method of claim 4, wherein the first response has a first information content, the second response has a second information content, and the level of agreement indicates a degree of similarity between at least the first information content and the second information content.

### Claim 6 (depends on 1)

The method of claim 1, wherein each prompt of the set of prompts:
is a solicitation for the same information content; and
uses a different phrasing from phrasings used by other prompts of the set of prompts.

### Claim 7 (depends on 6)

The method of claim 6, wherein obtaining the set of prompts comprises prompting a third inference model to generate the set of prompts.

### Claim 8 (depends on 1)

The method of claim 1, wherein the inference model is a first large language model (LLM) and the second inference model is a second LLM.

### Claim 9 (depends on 1)

The method of claim 1, wherein the inference model is a generative artificial intelligence (AI) model hosted by a remote resource.

### Claim 10 (depends on 9)

The method of claim 9, wherein the set of prompts are obtained using a local resource.

### Claim 11 (depends on 10)

The method of claim 10, wherein the local resource is owned by a first owner and the remote resource is owned by a second owner.

### Claim 12 (depends on 11)

The method of claim 11, wherein the remote resource is not controlled by the first owner.

### Claim 13

A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations for managing an inference model, the operations comprising:
obtaining a set of prompts for the inference model, the set of prompts being intended to elicit responses from the inference model that have a same information content;
obtaining, using the set of prompts, a set of responses from the inference model, the set of responses comprising:
a first response to a first prompt of the set of prompts; and
a second response to a second prompt of the set of prompts;
performing, using a second inference model, an agreement testing process to obtain a level of agreement between at least the first response and the second response;
making a determination regarding whether the level of agreement meets criteria;
in a first instance of the determination in which the level of agreement meets the criteria:
concluding that a consistency of the inference model is acceptable; and
in a second instance of the determination in which the level of agreement does not meet the criteria:
concluding that the consistency of the inference model is not acceptable.

### Claim 14 (depends on 13)

The non-transitory machine-readable medium of claim 13, wherein the operations further comprise:
in the first instance of the determination in which the level of agreement meets the criteria:
providing computer-implemented services using the inference model.

### Claim 15 (depends on 13)

The non-transitory machine-readable medium of claim 13, wherein the operations further comprise:
in the second instance of the determination in which the level of agreement does not meet the criteria:
excluding the inference model for provisioning of computer-implemented services.

### Claim 16 (depends on 13)

The non-transitory machine-readable medium of claim 13, wherein performing the agreement testing process comprises:
prompting the second inference model to compare an information content of at least the first response and the second response; and
obtaining an output from the second inference model, the output being usable to obtain the level of agreement.

### Claim 17

A data processing system, comprising:
a processor; and
a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations for managing an inference model, the operations comprising:
obtaining a set of prompts for the inference model, the set of prompts being intended to elicit responses from the inference model that have a same information content;
obtaining, using the set of prompts, a set of responses from the inference model, the set of responses comprising:
a first response to a first prompt of the set of prompts; and
a second response to a second prompt of the set of prompts;
performing, using a second inference model, an agreement testing process to obtain a level of agreement between at least the first response and the second response;
making a determination regarding whether the level of agreement meets criteria;
in a first instance of the determination in which the level of agreement meets the criteria:
concluding that a consistency of the inference model is acceptable; and
in a second instance of the determination in which the level of agreement does not meet the criteria:
concluding that the consistency of the inference model is not acceptable.

### Claim 18 (depends on 17)

The data processing system of claim 17, wherein the operations further comprise:
in the first instance of the determination in which the level of agreement meets the criteria:
providing computer-implemented services using the inference model.

### Claim 19 (depends on 17)

The data processing system of claim 17, wherein the operations further comprise:
in the second instance of the determination in which the level of agreement does not meet the criteria:
excluding the inference model for provisioning of computer-implemented services.

### Claim 20 (depends on 17)

The data processing system of claim 17, wherein performing the agreement testing process comprises:
prompting the second inference model to compare an information content of at least the first response and the second response; and
obtaining an output from the second inference model, the output being usable to obtain the level of agreement.
