# US 2026/0093551 A1 · System and method for determining execution performance of generative artificial intelligence (ai) models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0093551 A1
- Document ID: US20260093551A1
- Status: Published application
- Kind: A1
- Application number: 18/899,306
- Filed: 2024-09-27
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Assignees: SISA Information Security Pvt Ltd
- Applicants: SISA Information Security Pvt Ltd
- Inventors: Anjan Krishnamurthy; Mahesh R; Renju Varghese Jolly
- Web page: https://patentgrep.com/patent/US20260093551A1

## CPC

- G06F 9/505: {considering the load}
- G06N 3/045: Combinations of networks
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/047: Probabilistic or stochastic networks
- G06N 3/0475: Generative networks
- G06N 3/08: Learning methods
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N 3/09: Supervised learning
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 20/00: Machine learning
- G06N 20/10: using kernel methods, e.g. support vector machines [SVM]
- G06N 20/20: Ensemble learning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A system and method for determining execution performance of one or more generative artificial intelligence (AI) models are disclosed. The system comprises a workflow management subsystem, a data obtaining subsystem, a context retrieval subsystem, a score-generating subsystem, and a performance detection subsystem. The system is configured to evaluate at least one of: a correctness score, a pertinence score, a similarity score, a profanity score, a vulnerability score, and a perplexity score, based on comparing first output data (actual output) generated by the one or more generative AI models with input data and second output data (expected output). Based on these various metrics scores, the system is configured to generate a performance report for determining the execution performance of the one or more generative AI models.

## Claims

### Claim 1

A computer-implemented system for determining an execution performance of one or more generative artificial intelligence (AI) models, comprising:
one or more servers, comprising:
one or more hardware processors; and
a memory unit operatively connected to the one or more hardware processors, wherein the memory unit comprises a set of computer-readable instructions in form of a plurality of subsystems, configured to be executed by the one or more hardware processors, wherein the plurality of subsystems comprises:
a workflow management subsystem configured to operate the one or more generative artificial intelligence (AI) models within a controlled workflow by providing input data for obtaining first output data;
a data obtaining subsystem configured to obtain at least one of: the input data, the first output data, and second output data from at least one of: the one or more generative artificial intelligence (AI) models, one or more users, and historic system data;
a context retrieval subsystem configured to retrieve context information from at least one of: the input data and the second output data stored in one or more databases, based on one or more queries provided to the one or more generative artificial intelligence (AI) models;
a score-generating subsystem, comprising:
a correctness score generation subsystem configured to determine the correctness of the one or more generative artificial intelligence (AI) models based on performing a comparative analysis between the first output data against the second output data using at least one of: a pre-trained embedding model and a pre-trained X-encoder model for generating a correctness score;
an output data pertinence determination subsystem configured to determine a pertinence of the first output data for the provided input data to the one or more generative artificial intelligence (AI) models using at least one of: a pre-trained zero-shot classifier and a clustering process, to generate a pertinence score;
an output data deviation detection subsystem configured to identify a deviation of the first output data generated by the one or more generative artificial intelligence (AI) models from the provided input data based on at least of:
the comparative analysis between the first output data and the second output data, and
the comparative analysis between the first output data and the context information, for generating a similarity score;
a profanity detection subsystem configured to analyze the first output data to identify profanity data in the first output data using one or more machine learning models trained on pre-defined profanity data for generating a profanity score for the first output data; and
a vulnerability detection subsystem configured to determine a susceptibility of the first output data based on comparing the first output data with one or more jailbreaking test cases for generating a vulnerability score; and
a performance detection subsystem configured to execute a comparative analysis between at least one of: the correctness score, the pertinence score, the similarity score, the profanity score, and the vulnerability score against respective threshold scores to generate a performance report for determining the execution performance of the one or more generative artificial intelligence (AI) models.

### Claim 2 (depends on 1)

The computer-implemented system of claim 1, wherein the controlled workflow is a Retrieval Augmented Generation (RAG) workflow,
the controlled workflow is configured to retrieve the context information from the input data during the execution of the one or more generative artificial intelligence (AI) models and store in the one or more databases;
the controlled workflow is configured to assign one or more ranks to the retrieved context information for prioritizing optimal context information for generating one or more responses; and
the controlled workflow is configured to generate the one or more responses based on at least one of: the provided input data and the retrieved context information.

### Claim 3 (depends on 1)

The computer-implemented system of claim 1, wherein
the input data comprises one or more of: text data, numerical data, images, audio data, and video data, provided to the one or more generative artificial intelligence (AI) models for processing;
the first output data comprises results generated by the one or more generative artificial intelligence (AI) models in response to the input data, including one or more at least one of: predicted text, classified categories, generated images, audio transcriptions, and predicted numerical values; and
the second output data comprises at least one of: a set of expected results and ground truth data, comprises at least one of: predetermined data and derived data from historical data, used to evaluate the first output data provided by the one or more generative artificial intelligence (AI) models.

### Claim 4 (depends on 1)

The computer-implemented system of claim 1, wherein the context retrieval subsystem is configured to store the context information, the input data, the second output data, and the one or more queries in a form of one or more vector embeddings;
the context retrieval subsystem is configured with a cosine similarity model,
the cosine similarity model is configured to retrieve the context information based on determining a cosine angle between the one or more vector embeddings associated with the one or more queries and the one or more vector embeddings associated with the input data.

### Claim 5 (depends on 1)

The computer-implemented system of claim 1, wherein the pre-trained embedding model uses the cosine similarity model to identify a contextual relationship between the first output data and the second output data for generating a semantic similarity score, and
the pre-trained X-encoder model is configured to identify an intricate relationship between the first output data and the second output data for generating an X-encoder score.

### Claim 6 (depends on 5)

The computer-implemented system of claim 5, wherein the correctness score generation subsystem is further configured to regulate the semantic similarity score and the X-encoder score using a weighted combination based on a similarity threshold determined by a semantic similarity function,
wherein if the correctness score is one of: within a predefined correctness threshold score and equal to the predefined correctness threshold score, the computer-implemented system determines that the first output data is apposite with the provided input data; and
wherein if the correctness score exceeds the predefined correctness threshold score, the computer-implemented system determines that the first output data is inapt with the provided input data.

### Claim 7 (depends on 1)

The computer-implemented system of claim 1, wherein the output data pertinence determination subsystem is configured to map the one or more vector embeddings associated with the input data and the one or more vector embeddings associated with the first output data into a clustered space to determine a distance between the input data and the first output data for generating the pertinence score,
if the pertinence score is one of: within a predefined pertinence threshold score and equal to the predefined pertinence threshold score, the computer-implemented system determines that the first output data is at least one of: optimal correlated and neutral, with the provided input data; and
if the pertinence score exceeds the predefined pertinence threshold score, the computer-implemented system determines that the first output data is in contradiction to the provided input data.

### Claim 8 (depends on 1)

The computer-implemented system of claim 1, wherein the output data deviation detection subsystem is configured to identify a deviation of the output data based on comparing the similarity score with a predefined similarity threshold score,
if the similarity score is one of: within the predefined similarity threshold score and equal to the predefined similarity threshold score, the computer-implemented system determines that the first output data is in line with the input data; and
if the similarity score exceeds the predefined similarity threshold score, the computer-implemented system determines that the first output data is deviated from the provided input data.

### Claim 9 (depends on 1)

The computer-implemented system of claim 1, wherein the pre-defined profanity data is pre-processed to convert into one or more profanity data vectors,
the profanity detection subsystem is configured to assign each profanity data vector of the one or more profanity data vectors in relation to one or more profanity classifications,
the profanity detection subsystem is configured to classify the first output data into the one or more profanity classifications by comparing the one or more vector embeddings associated with the first output data against the one or more profanity data vectors, and
the profanity detection subsystem is configured to generate the profanity score based on a number of one or more vector embeddings associated with the first output data matched with the one or more profanity data vectors associated with the one or more profanity classifications.

### Claim 10 (depends on 9)

The computer-implemented system of claim 9, wherein if the profanity score is one of:
within a predefined profanity threshold score and equal to the predefined profanity threshold score, the computer-implemented system determines that the first output data is tolerable; and
wherein if the profanity score exceeds the predefined profanity threshold score, the computer-implemented system determines that the first output data contains exceptionable profanity data and triggers for at least one of: flagging and filtering, the profanity data.

### Claim 11 (depends on 1)

The computer-implemented system of claim 1, wherein the one or more machine learning models comprise an accurate gradient shallow decision tree model,
the accurate gradient shallow decision tree model is configured to identify the profanity data in the first output data based on the one or more profanity data vectors.

### Claim 12 (depends on 1)

The computer-implemented system of claim 1, wherein if the vulnerability score is one of: within a predefined vulnerability threshold score and equal to the predefined vulnerability threshold score, the computer-implemented system determines that the one or more generative artificial intelligence (AI) models are benign; and
wherein if the vulnerability score exceeds the predefined vulnerability threshold score, the computer-implemented system determines that the one or more generative artificial intelligence (AI) models are malignant.

### Claim 13 (depends on 1)

The computer-implemented system of claim 1, wherein the performance detection subsystem is configured to generate the performance report in form at least one of: radar charts, bar charts, line charts, pie charts; scatter plots, and bubble charts,
the generated performance report comprises one or more actionable recommendations for optimizing the performance of the one or more generative artificial intelligence (AI) models based on identified at least one of: the correctness score, the pertinence score, the similarity score, the profanity score, and the vulnerability score.

### Claim 14 (depends on 1)

The computer-implemented system of claim 1, wherein the threshold scores comprise at least one of: the predefined correctness threshold score, the predefined pertinence threshold score, the predefined similarity threshold score, the predefined profanity threshold score, and the predefined vulnerability threshold score.

### Claim 15 (depends on 1)

The computer-implemented system of claim 1, wherein the plurality of subsystems further comprises:
a predictability subsystem configured to determine a probability of each consecutive action of one or more actions to execute in the first output data using an n-gram language model to evaluate the execution performance of one or more generative artificial intelligence (AI) models; and
a feedback loop subsystem configured to continuously re-evaluate the one or more generative artificial intelligence (AI) models based on real-time at least one of: the input data, artificial intelligence (AI) model configurations, and evaluation results, for generating real-time performance reports.

### Claim 16 (depends on 15)

The computer-implemented system of claim 15, wherein the predictability subsystem is configured to:
train the n-gram language model on the input data;
determine the probability of each consecutive action of the one or more actions using trained n-gram language model to generate a perplexity score;
normalize the generated perplexity score to a defined perplexity range;
if the perplexity score is one of: within a predefined perplexity threshold score of the defined perplexity range and equal to the predefined perplexity threshold score of the defined perplexity range, the computer-implemented system determines that the probability of predicting each consecutive action of one or more actions is superior; and
if the perplexity score exceeds the predefined perplexity threshold score of the defined perplexity range, the computer-implemented system determines the probability of predicting each consecutive action of one or more actions is inferior.

### Claim 17

A computer-implemented method for determining an execution performance of one or more generative artificial intelligence (AI) models, comprising:
operating, by one or more servers through a workflow management subsystem, the one or more generative artificial intelligence (AI) models within a controlled workflow by providing input data to obtain first output data;
obtaining, by the one or more servers through a data obtaining subsystem, at least one of: the input data, the first output data, and second output data from at least one of: the one or more generative artificial intelligence (AI) models, one or more users, and historic system data;
retrieving, by the one or more servers through a context retrieval subsystem, context information from at least one of: the input data and the second output data stored in one or more databases, based on one or more queries provided to the one or more generative artificial intelligence (AI) models;
generating, by the one or more servers through a score-generating subsystem, comprises:
determining, by a correctness score generation subsystem, the correctness of the one or more generative artificial intelligence (AI) models based on performing a comparative analysis between the first output data against the second output data using at least one of: a pre-trained embedding model and a pre-trained X-encoder model for generating a correctness score;
determining, by an output data pertinence determination subsystem, a pertinence of the first output data for the provided input data to the one or more generative artificial intelligence (AI) models using at least one of: a pre-trained zero-shot classifier and a clustering process, to generate a pertinence score;
identifying, by an output data deviation detection subsystem, a deviation of the first output data generated by the one or more generative artificial intelligence (AI) models from the provided input data based on at least one of:
the comparative analysis between the first output data and the second output data, and
the comparative analysis between the first output data and the context information, for generating a similarity score;
analyzing, by a profanity detection subsystem, the first output data to identify profanity data in the first output data using one or more machine learning models trained on pre-defined profanity data for generating a profanity score for the first output data; and
determining, by a vulnerability detection subsystem, a susceptibility of the first output data based on comparing the first output data with one or more jailbreaking test cases for generating a vulnerability score; and
executing, by the one or more servers through a performance detection subsystem, a comparative analysis between at least one of: the correctness score, the pertinence score, the similarity score, the profanity score, and the vulnerability score against respective threshold scores to generate a performance report to determine the execution performance of the one or more generative artificial intelligence (AI) models.

### Claim 18 (depends on 17)

The computer-implemented method of claim 17, further comprising:
determining, by the one or more servers through a predictability subsystem, a probability of each consecutive action of one or more actions to execute in the first output data using an n-gram language model to evaluate the execution performance of the one or more generative artificial intelligence (AI) models; and
re-evaluating, by the one or more servers through a feedback loop subsystem, the one or more generative artificial intelligence (AI) models based on real-time at least one of: the input data, artificial intelligence (AI) model configurations, and evaluation results, to generate real-time performance reports.

### Claim 19

A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by one or more hardware processors, cause the one or more hardware processors to perform operations for determining an execution performance of one or more generative artificial intelligence (AI) models, the operations comprising:
operating the one or more generative artificial intelligence (AI) models within a controlled workflow by providing input data to obtain first output data;
obtaining at least one of: the input data, the first output data, and second output data from at least one of: the one or more generative artificial intelligence (AI) models, one or more users, and historic system data;
retrieving context information from at least one of: the input data and the second output data stored in one or more databases, based on one or more queries provided to the one or more generative artificial intelligence (AI) models;
determining the correctness of the one or more generative artificial intelligence (AI) models based on performing a comparative analysis between the first output data against the second output data using at least one of: a pre-trained embedding model and a pre-trained X-encoder model for generating a correctness score;
determining a pertinence of the first output data for the provided input data to the one or more generative artificial intelligence (AI) models using at least one of: a pre-trained zero-shot classifier and a clustering process, to generate a pertinence score;
identifying a deviation of the first output data generated by the one or more generative artificial intelligence (AI) models from the provided input data based on at least one of:
the comparative analysis between the first output data and the second output data, and
the comparative analysis between the first output data and the context information, for generating a similarity score;
analyzing the first output data to identify profanity data in the first output data using one or more machine learning models trained on pre-defined profanity data for generating a profanity score for the first output data;
determining a susceptibility of the first output data based on comparing the first output data with one or more jailbreaking test cases for generating a vulnerability score; and
executing a comparative analysis between at least one of: the correctness score, the pertinence score, the similarity score, the profanity score, and the vulnerability score against respective threshold scores to generate a performance report to determine the execution performance of the one or more generative artificial intelligence (AI) models.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, further comprising:
determining, by the one or more servers through a predictability subsystem, a probability of each consecutive action of one or more actions to execute in the first output data using an n-gram language model to evaluate the execution performance of one or more generative artificial intelligence (AI) models; and
re-evaluating, by the one or more servers through a feedback loop subsystem, the one or more generative artificial intelligence (AI) models based on real-time at least one of: the input data, artificial intelligence (AI) model configurations, and evaluation results, to generate real-time performance reports.
