Methods and systems for identifying, avoiding, or reducing hallucinations or other inaccuracies in generative artificial intelligence output

A computer-implemented method of improving accuracy of generative artificial intelligence (Gen AI) model output, the method comprising:

• at an electronic device:
• identifying a context-specific data set comprising factual information associated with a context;
• receiving output of the Gen AI model, wherein the Gen AI model produced the output based on an input query and information from the context-specific data set, wherein the Gen AI model produces outputs with a first level of inaccuracies;
• generating an accuracy score for the output corresponding to the first level of inaccuracies, the accuracy score generated based on a comparison of the output with the context-specific data set, wherein the comparison assesses similarity between groups of one or more words of the output with one or more words of the context-specific data set;
• determining that the output satisfies an accuracy criterion based on the accuracy score;
• and
• based on determining that the output satisfies the accuracy criterion, initiating an action to enable the output to be provided in response to the input query.

A system comprising:

• a non-transitory computer-readable storage medium;
• and
• one or more processors coupled to the non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises program instructions that, when executed on the one or more processors, cause the first device to perform operations comprising:
• identifying a context-specific data set comprising factual information associated with a context;
• receiving output of the Gen AI model, wherein the Gen AI model produced the output based on an input query and information from the context-specific data set, wherein the Gen AI model produces outputs with a first level of inaccuracies;
• generating an accuracy score for the output corresponding to the first level of inaccuracies, the accuracy score generated based on a comparison of the output with the context-specific data set, wherein the comparison assesses similarity between groups of one or more words of the output with one or more words of the context-specific data set;
• determining that the output fails to satisfy an accuracy criterion based on the accuracy score;
• and
• based on determining that the output fails to satisfy the accuracy criterion, initiating an action to provide a second output to the input query, wherein the action has an action type that produces the second output with a second level of inaccuracies that is less than the first level of inaccuracies;
• and
• based on determining that the output satisfies the accuracy criterion, initiating an action to enable the output to be provided in response to the input query.