HALLUCINATION DETECTION SYSTEM FOR LARGE LANGUAGE MODELS (LLMs)
OwnerRichard Gardner, John Jozwiakinventors
Life of this patent
Estimating the term…
Loading patent…
OwnerRichard Gardner, John Jozwiakinventors
Estimating the term…
A method of detecting hallucinations by large language models (LLMs) is disclosed. A first prompt is received. The first prompt is submitted to an LLM. A first response is received from the LLM. The first response is generated by the LLM in response to the first prompt. A second prompt is generated. The second prompt is designed to detect a probability that the first response includes a hallucination. The second prompt is submitted to the LLM or an additional LLM. A second response is received. The second response is generated by the LLM or the additional LLM in response to the second prompt. The second response is analyzed to perform the detecting of the probability that the first response includes the hallucination. A third response is generated based on the analyzing of the second response. The third response is provided in response to the first prompt.
A system comprising:
(canceled)
A method comprising:
A non-transitory computer-readable storage medium storing a set of instructions that, when executed by one or more computer processors, causes the one or more computer processors to perform operations, the operations comprising:
Dependencies are inferred from the claim text.