Computer implemented methods for the automated analysis or use of data, including use of a large language model

A computer implemented system configured to automatically remove hallucinations from natural language text generated by a LLM, the system being configured to:

• (a) receive a prompt or query to the LLM;
• (b) automatically generate a baseline response to the prompt or query, the baseline response including factual assertions;
• (c) automatically generate one or more verification questions to test the accuracy of one or more of the factual assertions for factual accuracy or inaccuracy;
• (d) systematically answer the or each verification questions in a manner that is not dependent on the baseline response;
• (e) use the answers to the or each verification question to identify one or more factual inaccuracies or hallucinations present in the baseline response;
• (f) automatically use the or each answer to the verification question or questions to generate a final natural language output, in which one or more factual inaccuracies or hallucinations present in the baseline response, have been removed.

A large language model system configured to automatically remove hallucinations from natural language text generated by the LLM system, the LLM system being configured to:

• (a) receive a prompt or query;
• (b) automatically generate a baseline response to the prompt or query, the baseline response including factual assertions;
• (c) automatically generate one or more verification questions to test the accuracy of one or more of the factual assertions for factual accuracy or inaccuracy;
• (d) systematically answer the or each verification questions in a manner that is not dependent on the baseline response;
• (e) use the answers to the or each verification question to identify one or more factual inaccuracies or hallucinations present in the baseline response;
• (f) automatically use the or each answer to the verification question or questions to generate a final natural language output, in which one or more factual inaccuracies or hallucinations present in the baseline response, have been removed.