System and method for intelligent evaluation of artificial intelligence generated texts

A computerized system for automatically evaluating computer generated content, the system comprising:

• a memory,
• and a computer processor configured to:
• calculate a plurality of metrics for an input text, the plurality of metrics comprising one or more perplexity scores, the one or more perplexity scores describing a prediction of the input text by a large language model (LLM);
• determine, based on one or more of the calculated plurality of metrics, whether to accept or reject the input text;
• and
• perform an exchange of data between remotely connected computer devices based on the determining to accept or reject the input text.

A computerized method of automatically evaluating an input text, the method comprising, using a computer processor:

• computing a plurality of scores for the input text, the plurality of computed scores comprising one or more perplexity metrics, the one or more perplexity metrics describing a generation of the input text by a generative artificial intelligence (GenAI) model;
• determining, based on one or more of the plurality of computed scores, whether to approve or dismiss the input text;
• and
• saving an update to the GenAI model based on the determining whether to approve or dismiss the input text.