# US 2026/0093913 A1 · Managing deviation between inference models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0093913 A1
- Document ID: US20260093913A1
- Status: Published application
- Kind: A1
- Application number: 18/899,236
- Filed: 2024-09-27
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Assignees: Dell Products L.P.
- Applicants: Dell Products L.P.
- Inventors: OFIR EZRIELEV; JEHUDA SHEMER; ONUR CELEBIOGLU
- Web page: https://patentgrep.com/patent/US20260093913A1

## CPC

- G06F 40/20: Natural language analysis (semantic analysis of natural language G06F40/30)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods and systems for managing inference models are disclosed. To do so, an existing inference model that is deemed both internally consistent and correct may be used to evaluate an internal consistency and a correctness of a new inference model via performing an inference model divergence test. During the inference model divergence test, at least a minimum number of repeated cycles of response generation and prompt reconstruction may be performed by both the new inference model and the existing inference model. A degree of divergence may be obtained based on the operation of the new inference model and the operation of the existing inference model over time. If the degree of divergence falls below a degree of divergence threshold, the new inference model may be deemed both internally consistent and correct and, therefore, may be approved for us in providing computer-implemented services.

## Claims

### Claim 1

A method for managing inference models, the method comprising:
obtaining a new inference model based on an existing inference model, the existing inference model being deemed both internally consistent and correct;
obtaining a set of prompts based on a knowledge base of the existing inference model;
obtaining, using the set of prompts, a first set of responses from the new inference model and a second set of responses from the existing inference model;
performing, using at least the first set of responses and the second set of responses, an inference model divergence test to obtain a degree of deviation between operation of the new inference model and operation of the existing inference model;
making a determination regarding whether the degree of deviation is acceptable;
in a first instance of the determination in which the degree of deviation is acceptable:
concluding that the new inference model is both internally consistent and correct; and
using the new inference model to provide computer-implemented services.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
in a second instance of the determination in which the degree of deviation is not acceptable:
provisionally rejecting the new inference model for providing the computer-implemented services.

### Claim 3 (depends on 1)

The method of claim 1, wherein performing the inference model divergence test comprises:
performing a first prompt reconstruction process to obtain a first reconstructed set of prompts from the new inference model and a second reconstructed set of prompts from the existing inference model;
obtaining, using the first reconstructed set of prompts, a third set of responses from the new inference model;
obtaining, using the second reconstructed set of prompts, a fourth set of responses from the existing inference model; and
performing, using at least the third set of responses and the fourth set of responses, a comparison process to obtain the degree of deviation.

### Claim 4 (depends on 3)

The method of claim 3, wherein performing the inference model divergence test further comprises:
performing a second prompt reconstruction process to obtain a third reconstructed set of prompts from the new inference model and a fourth reconstructed set of prompts from the existing inference model;
obtaining, using the third reconstructed set of prompts, a fifth set of responses from the new inference model;
obtaining, using the fourth reconstructed set of prompts, a sixth set of responses from the existing inference model; and
updating, using at least the fifth set of responses and the sixth set of responses, the degree of deviation to obtain an updated degree of deviation.

### Claim 5 (depends on 3)

The method of claim 3, wherein performing the first prompt reconstruction process comprises:
prompting, using the first set of responses, the new inference model to generate the first reconstructed set of prompts,
wherein the first set of responses are deemed potentially responsive to the first set of reconstructed prompts by the new inference model; and
prompting, using the second set of responses, the existing inference model to generate the second reconstructed set of prompts,
wherein the second set of responses are deemed potentially responsive to the second reconstructed set of prompts by the existing inference model.

### Claim 6 (depends on 1)

The method of claim 1, wherein performing the inference model divergence test comprises performing, using the new inference model and the existing inference model, repeated cycles of response generation and prompt reconstruction.

### Claim 7 (depends on 6)

The method of claim 6, wherein the degree of deviation is acceptable when the operation of the existing inference model is deemed consistent with the operation of the existing inference model following performance of a minimum number of the repeated cycles.

### Claim 8 (depends on 1)

The method of claim 1, wherein the existing inference model is a first large language model (LLM) and the new inference model is a second LLM.

### Claim 9 (depends on 1)

The method of claim 1, wherein the existing inference model is a generative artificial intelligence (AI) model hosted by a remote resource.

### Claim 10 (depends on 9)

The method of claim 9, wherein the set of prompts are obtained using a local resource.

### Claim 11 (depends on 10)

The method of claim 10, wherein the local resource is owned by a first owner and the remote resource is owned by a second owner.

### Claim 12 (depends on 11)

The method of claim 11, wherein the remote resource is not controlled by the first owner.

### Claim 13

A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations for managing inference models, the operations comprising:
obtaining a new inference model based on an existing inference model, the existing inference model being deemed both internally consistent and correct;
obtaining a set of prompts based on a knowledge base of the existing inference model;
obtaining, using the set of prompts, a first set of responses from the new inference model and a second set of responses from the existing inference model;
performing, using at least the first set of responses and the second set of responses, an inference model divergence test to obtain a degree of deviation between operation of the new inference model and operation of the existing inference model;
making a determination regarding whether the degree of deviation is acceptable;
in a first instance of the determination in which the degree of deviation is acceptable:
concluding that the new inference model is both internally consistent and correct; and
using the new inference model to provide computer-implemented services.

### Claim 14 (depends on 13)

The non-transitory machine-readable medium of claim 13, wherein the operations further comprise:
in a second instance of the determination in which the degree of deviation is not acceptable:
provisionally rejecting the new inference model for providing the computer-implemented services.

### Claim 15 (depends on 13)

The non-transitory machine-readable medium of claim 13, wherein performing the inference model divergence test comprises:
performing a first prompt reconstruction process to obtain a first reconstructed set of prompts from the new inference model and a second reconstructed set of prompts from the existing inference model;
obtaining, using the first reconstructed set of prompts, a third set of responses from the new inference model;
obtaining, using the second reconstructed set of prompts, a fourth set of responses from the existing inference model; and
performing, using at least the third set of responses and the fourth set of responses, a comparison process to obtain the degree of deviation.

### Claim 16 (depends on 15)

The non-transitory machine-readable medium of claim 15, wherein performing the inference model divergence test further comprises:
performing a second prompt reconstruction process to obtain a third reconstructed set of prompts from the new inference model and a fourth reconstructed set of prompts from the existing inference model;
obtaining, using the third reconstructed set of prompts, a fifth set of responses from the new inference model;
obtaining, using the fourth reconstructed set of prompts, a sixth set of responses from the existing inference model; and
updating, using at least the fifth set of responses and the sixth set of responses, the degree of deviation to obtain an updated degree of deviation.

### Claim 17

A data processing system, comprising:
a processor; and
a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations for managing inference models, the operations comprising:
obtaining a new inference model based on an existing inference model, the existing inference model being deemed both internally consistent and correct;
obtaining a set of prompts based on a knowledge base of the existing inference model;
obtaining, using the set of prompts, a first set of responses from the new inference model and a second set of responses from the existing inference model;
performing, using at least the first set of responses and the second set of responses, an inference model divergence test to obtain a degree of deviation between operation of the new inference model and operation of the existing inference model;
making a determination regarding whether the degree of deviation is acceptable;
in a first instance of the determination in which the degree of deviation is acceptable:
concluding that the new inference model is both internally consistent and correct; and
using the new inference model to provide computer-implemented services.

### Claim 18 (depends on 17)

The data processing system of claim 17, wherein the operations further comprise:
in a second instance of the determination in which the degree of deviation is not acceptable:
provisionally rejecting the new inference model for providing the computer-implemented services.

### Claim 19 (depends on 17)

The data processing system of claim 17, wherein performing the inference model divergence test comprises:
performing a first prompt reconstruction process to obtain a first reconstructed set of prompts from the new inference model and a second reconstructed set of prompts from the existing inference model;
obtaining, using the first reconstructed set of prompts, a third set of responses from the new inference model;
obtaining, using the second reconstructed set of prompts, a fourth set of responses from the existing inference model; and
performing, using at least the third set of responses and the fourth set of responses, a comparison process to obtain the degree of deviation.

### Claim 20 (depends on 19)

The data processing system of claim 19, wherein performing the inference model divergence test further comprises:
performing a second prompt reconstruction process to obtain a third reconstructed set of prompts from the new inference model and a fourth reconstructed set of prompts from the existing inference model;
obtaining, using the third reconstructed set of prompts, a fifth set of responses from the new inference model;
obtaining, using the fourth reconstructed set of prompts, a sixth set of responses from the existing inference model; and
updating, using at least the fifth set of responses and the sixth set of responses, the degree of deviation to obtain an updated degree of deviation.
