Loading patent…
AssigneeThe PNC Financial Services Group, Inc.
InventorsTrevor Daniel Sullivan, Sage Jordan Betko
Estimating the term…
Technologies for determining discernment in generative artificial intelligence include a compute device. The compute device includes circuitry configured to obtain a testing dataset comprising a plurality of questions and responses between one or more users and one or more large language models. In some cases, the responses from the one or more large language models are based, at least in part, on information in a knowledge base. The circuitry may be further configured to determine a discernment score for the testing dataset in which the discernment score represents a measurement of whether there was enough information in the knowledge base for the one or more large language models to answer the questions in the testing dataset. Other embodiments are also described.
A compute device comprising:
One or more machine-readable storage media comprising a plurality of instructions stored thereon that, in response to being executed, cause a compute device to:
A compute device comprising:
Dependencies are inferred from the claim text.