Back to results
US 2025/0061279 A1Published application
Hallucination detection and remediation in text generation interface systems
AssigneeCasetext, Inc.
InventorAlan deLevie
Life of this patent
Estimating the term…
Abstract
Enumerated source text passages may be determined based on one or more source text documents. The enumerated source text passages may include source text passage identifiers uniquely identifying the passages. A novel text passage including novel text portions may be determined based on a query and the enumerated source text passages. One or more of the novel text portions may be verified by a large language model to produce text verification information. A novel text generation message including novel text generated by the large language model may be determined based on the text verification information and sent to a client machine.
Claims20
A method comprising:
- determining a plurality of enumerated source text passages based on one or more source text documents, each of the plurality of enumerated source text passages being included in one or more of the source text documents, each enumerated source text passage of the plurality of enumerated source text passages including a respective source text passage identifier that uniquely identifies the enumerated source text passage;
- determining a novel text passage based on a query and the plurality of enumerated source text passages, the novel text passage including a plurality of novel text portions, one or more text portions of the plurality of novel text portions including a respective one or more cited source text passage identifiers;
- transmitting a text verification prompt to a large language model, the text verification prompt including a designated novel text portion of the plurality of novel text portions, the text verification prompt including a designated one or more enumerated source text passages identified in the designated novel text portion, the text verification prompt including a natural language instruction to evaluate whether the designated novel text portion is supported by the designated one or more enumerated source text passages;
- receiving from the large language model a text verification response message including text verification information indicating that the designated novel text portion is insufficiently supported by the designated one or more enumerated source text passages;
- and
- transmitting to a client machine a novel text generation message determined based on the text verification information and including novel text generated by the large language model.
3 more elements
One or more non-transitory computer readable media having instructions stored thereon for performing a method, the method comprising:
- determining a plurality of enumerated source text passages based on one or more source text documents, each of the plurality of enumerated source text passages being included in one or more of the source text documents, each enumerated source text passage of the plurality of enumerated source text passages including a respective source text passage identifier that uniquely identifies the enumerated source text passage;
- determining a novel text passage based on a query and the plurality of enumerated source text passages, the novel text passage including a plurality of novel text portions, one or more text portions of the plurality of novel text portions including a respective one or more cited source text passage identifiers;
- transmitting a text verification prompt to a large language model, the text verification prompt including a designated novel text portion of the plurality of novel text portions, the text verification prompt including a designated one or more enumerated source text passages identified in the designated novel text portion, the text verification prompt including a natural language instruction to evaluate whether the designated novel text portion is supported by the designated one or more enumerated source text passages;
- receiving from the large language model a text verification response message including text verification information indicating that the designated novel text portion is insufficiently supported by the designated one or more enumerated source text passages;
- and
- transmitting to a client machine a novel text generation message determined based on the text verification information and including novel text generated by the large language model.
3 more elements
A system configured to perform a method, the method comprising:
- determining a plurality of enumerated source text passages based on one or more source text documents, each of the plurality of enumerated source text passages being included in one or more of the source text documents, each enumerated source text passage of the plurality of enumerated source text passages including a respective source text passage identifier that uniquely identifies the enumerated source text passage;
- determining a novel text passage based on a query and the plurality of enumerated source text passages, the novel text passage including a plurality of novel text portions, one or more text portions of the plurality of novel text portions including a respective one or more cited source text passage identifiers;
- transmitting a text verification prompt to a large language model, the text verification prompt including a designated novel text portion of the plurality of novel text portions, the text verification prompt including a designated one or more enumerated source text passages identified in the designated novel text portion, the text verification prompt including a natural language instruction to evaluate whether the designated novel text portion is supported by the designated one or more enumerated source text passages;
- receiving from the large language model a text verification response message including text verification information indicating that the designated novel text portion is insufficiently supported by the designated one or more enumerated source text passages;
- and
- transmitting to a client machine a novel text generation message determined based on the text verification information and including novel text generated by the large language model.
3 more elements
Dependencies are inferred from the claim text.