Verification and citation for language model outputs

A method comprising:

• receiving at least a free-form description of a question;
• converting the free-form description of the question into a query;
• determining comparisons of an embedding generated based at least in part on the query to each of a plurality of embeddings, wherein each of the plurality of embeddings represents at least one of a plurality of text chunks extracted from a plurality of documents and augmented with temporal metadata, and wherein the embedding and each of the plurality of embeddings is in a common vector space;
• selecting at least a subset of the plurality of text chunks based at least in part on the comparisons;
• generating, using a large language model, a response to the question based at least in part on the subset of the plurality of text chunks, wherein the response comprises a set of data points identified based at least in part on the temporal metadata;
• identifying one of the plurality of documents including at least one data point of the set of data points;
• and
• providing the response to the question and at least an identifier of the one of the plurality of documents.

A non-transitory computer-readable storage medium having executable instructions stored thereon that, when executed by one or more processors of a computer system, cause the computer system to at least:

• receive at least a query;
• generate a response to the query based at least in part on a plurality of text chunks extracted from a corpus of documents, wherein the plurality of text chunks are augmented with temporal metadata and indexed in a database, and wherein the response includes a first set of quantitative data points identified based at least in part on the temporal metadata;
• identify a second set of quantitative data points based at least in part on the response, wherein each one of the second set of quantitative data points corresponds to one of the first set of quantitative data points;
• compare a first quantitative data point of the first set of quantitative data points to a second quantitative data point of the second set of quantitative data points;
• and
• provide at least a portion of the response and an identifier of a source of a quantitative data point in the portion of the response,
• wherein the quantitative data point in the portion of the response is the first quantitative data point and the source is one of the corpus of documents including the first quantitative data point if the first quantitative data point equals the second quantitative data point, and
• wherein the quantitative data point in the portion of the response is the second quantitative data point and the source is one of the corpus of documents including the second quantitative data point if the first quantitative data point does not equal the second quantitative data point.