# US 2026/0094012 A1 · Managing inference models trained on an expanded knowledge base

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0094012 A1
- Document ID: US20260094012A1
- Status: Published application
- Kind: A1
- Application number: 18/899,231
- Filed: 2024-09-27
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Assignees: Dell Products L.P.
- Applicants: Dell Products L.P.
- Inventors: OFIR EZRIELEV; JEHUDA SHEMER; ONUR CELEBIOGLU
- Web page: https://patentgrep.com/patent/US20260094012A1

## CPC

- G06N 5/022: Knowledge engineering; Knowledge acquisition
- G06N 5/04: Inference or reasoning models
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Methods and systems for providing computer-implemented services using inference models are disclosed. To provide the computer-implemented services, a new inference model may be obtained based on an existing inference model and supplemental training data. A set of prompts may be obtained based on the supplemental training data. A first attempting may be performed to verify that the new inference model provides consistent responses to the set of prompts. If the new inference model provides the consistent responses, a second attempting may be performed to verify that the existing inference model provides inconsistent responses to the set of prompts. If the existing inference model provides the inconsistent responses, it may be concluded that the set of prompts is usable to ascertain whether the new inference model has an expanded knowledge base. The set of prompts and the new inference model may be used to provide the computer-implemented services.

## Claims

### Claim 1

A method for providing computer-implemented services using inference models, the method comprising:
obtaining a new inference model based on an existing inference model and supplemental training data;
obtaining a set of prompts based on the supplemental training data;
performing a first attempting to verify that the new inference model provides consistent responses to the set of prompts;
in a first instance of the first attempting where the new inference model provides the consistent responses:
performing a second attempting to verify that the existing inference model provides inconsistent responses to the set of prompts;
in a first instance of the second attempting where the existing inference model provides the inconsistent responses:
concluding that the set of prompts is usable to ascertain whether the new inference model has an expanded knowledge base when compared to a knowledge base of the existing inference model; and
using the set of prompts and the new inference model to provide the computer-implemented services.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
in a second instance of the first attempting where the new inference model does not provide the consistent responses:
concluding that the set of prompts is not usable to ascertain whether the new inference model has an expanded knowledge base.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
in a second instance of the second attempting where the existing inference model provides the consistent responses:
concluding that the set of prompts is not usable to ascertain whether the new inference model has an expanded knowledge base.

### Claim 4 (depends on 1)

The method of claim 1, wherein using the set of prompts comprises:
performing, using the set of prompts, a third attempting to verify that the new inference model has the expanded knowledge base;
in a first instance of the performing of the third attempting where the new inference model has the expanded knowledge base:
providing the computer-implemented services using the new inference model; and
in a second instance of the performing of the third attempting where the new inference model does not have the expanded knowledge base:
remediating the new inference model prior to using the new inference model to provide the computer-implemented services.

### Claim 5 (depends on 1)

The method of claim 1, wherein the set of prompts is adapted to elicit responses from inference models comprising information content from the supplemental training data.

### Claim 6 (depends on 5)

The method of claim 5, wherein the existing inference model is based on a base set of training data that excludes the supplemental training data, and the information content from the supplemental training data is not part of the base set of training data.

### Claim 7 (depends on 1)

The method of claim 1, wherein the new inference model and the existing inference model are known to provide consistent responses to a second set of prompts, the second set of prompts being based on the knowledge base of the existing inference model.

### Claim 8 (depends on 7)

The method of claim 7, wherein the existing inference model provides accurate responses to the second set of prompts.

### Claim 9 (depends on 1)

The method of claim 1, wherein the existing inference model providing the inconsistent responses to the set of prompts indicates that the existing inference model is not trained on the expanded knowledge base.

### Claim 10 (depends on 1)

The method of claim 1, wherein performing the first attempting comprises:
obtaining, using the set of prompts, a set of responses from the new inference model, the set of responses comprising:
a first response to a first prompt of the set of prompts; and
a second response to a second prompt of the set of prompts;
performing a response agreement testing process to obtain a level of agreement between at least the first response and the second response;
making a determination regarding whether the level of agreement meets criteria;
in a first instance of the determination in which the level of agreement meets the criteria:
concluding that the new inference model provides the consistent responses to the set of prompts; and
in a second instance of the determination in which the level of agreement does not meet the criteria:
concluding that the new inference model does not provide the consistent responses to the set of prompts.

### Claim 11 (depends on 1)

The method of claim 1, wherein the existing inference model is a generative artificial intelligence (AI) models hosted by a remote resource.

### Claim 12 (depends on 11)

The method of claim 11, wherein the set of prompts is obtained using a local resource.

### Claim 13 (depends on 12)

The method of claim 12, wherein the local resource is owned by a first owner and the remote resource is owned by a second owner.

### Claim 14 (depends on 13)

The method of claim 13, wherein the remote resource is not controlled by the first owner.

### Claim 15

A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations for providing computer-implemented services using inference models, the operations comprising:
obtaining a new inference model based on an existing inference model and supplemental training data;
obtaining a set of prompts based on the supplemental training data;
performing a first attempting to verify that the new inference model provides consistent responses to the set of prompts;
in a first instance of the first attempting where the new inference model provides the consistent responses:
performing a second attempting to verify that the existing inference model provides inconsistent responses to the set of prompts;
in a first instance of the second attempting where the existing inference model provides the inconsistent responses:
concluding that the set of prompts is usable to ascertain whether the new inference model has an expanded knowledge base when compared to a knowledge base of the existing inference model; and
using the set of prompts and the new inference model to provide the computer-implemented services.

### Claim 16 (depends on 15)

The non-transitory machine-readable medium of claim 15, wherein the operations further comprise:
in a second instance of the first attempting where the new inference model does not provide the consistent responses:
concluding that the set of prompts is not usable to ascertain whether the new inference model has an expanded knowledge base.

### Claim 17 (depends on 15)

The non-transitory machine-readable medium of claim 15, wherein the operations further comprise:
in a second instance of the second attempting where the existing inference model provides the consistent responses:
concluding that the set of prompts is not usable to ascertain whether the new inference model has an expanded knowledge base.

### Claim 18

A data processing system, comprising:
a processor; and
a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations for providing computer-implemented services using inference models, the operations comprising:
obtaining a new inference model based on an existing inference model and supplemental training data;
obtaining a set of prompts based on the supplemental training data;
performing a first attempting to verify that the new inference model provides consistent responses to the set of prompts;
in a first instance of the first attempting where the new inference model provides the consistent responses:
performing a second attempting to verify that the existing inference model provides inconsistent responses to the set of prompts;
in a first instance of the second attempting where the existing inference model provides the inconsistent responses:
concluding that the set of prompts is usable to ascertain whether the new inference model has an expanded knowledge base when compared to a knowledge base of the existing inference model; and
using the set of prompts and the new inference model to provide the computer-implemented services.

### Claim 19 (depends on 18)

The data processing system of claim 18, wherein the operations further comprise:
in a second instance of the first attempting where the new inference model does not provide the consistent responses:
concluding that the set of prompts is not usable to ascertain whether the new inference model has an expanded knowledge base.

### Claim 20 (depends on 18)

The data processing system of claim 18, wherein the operations further comprise:
in a second instance of the second attempting where the existing inference model provides the consistent responses:
concluding that the set of prompts is not usable to ascertain whether the new inference model has an expanded knowledge base.
