US 12,614,026 B1Granted

Reference and training data validation for machine learning models

AssigneeAmazon Technologies, Inc.

InventorsAnthony Edward Leonard, Rohan Patil

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and methods are provided for a prompt and content generation service to validate generated references and training data sets of large language models (LLMs). The prompt and content generation service may determine if a reference generated by an LLM is valid by searching a training dataset for tokens using a prompt, generated answer, and generated reference for content and references in the training data set. If the prompt and content generation service finds content or a valid reference with a certain confidence level, the prompt and content generation service may indicate that the generated content and reference is valid. The prompt and content generation service may additionally validate a saved checkpoint during training of an LLM by executing use case scenarios against the LLM checkpoint and determining if expected answers match generated answers.

Claims19

Dependent claims

A computing device for validating content and references generated by large language models (LLMs), the computing device comprising:

computer-readable memory storing executable instructions;
and
at least one computing device in communication with the computer-readable memory and programmed by the executable instructions to:
receive a prompt with a natural language question, image, or sound;
generate, via an LLM, content and a reference in response to the prompt, wherein the LLM was trained using training data, and wherein the training data comprise content and predetermined references associated with the content;
determine a characterization of matching by searching the training data to identify matches between the (i) content and the reference and (ii) the training data, wherein the characterization of matching comprises a full match, partial match, and no match;
and
if there was a full match:
return the generated content and the reference, as an output to the prompt, wherein the output comprises a notification that the reference is associated with attribution data of the training data;
if there was a partial match:
determine a confidence score based on a degree of matching between the (i) content and the reference and (ii) the training data;
return the content, the reference, and the confidence score as an output to the prompt, wherein the output comprises a notification that the reference was a partial match;
and
if there was no match:
return the generated content and reference as an output to the prompt, wherein the output comprises a notification that the generated content and reference could not be determined to be associated with attribution data of the training data.

12 more elements

Dependencies are inferred from the claim text.