Auto-Tagging for Retrieval-Augmented Generation Retrieval Accuracy

A method, comprising:

• splitting, by a system comprising at least one processor, a document into chunks, wherein the splitting is performed independently of a token size, and
• splitting, by the system, the chunks into embeddings;
• based on receiving a prompt to a large language model and at least one tag, wherein the prompt and the at least one tag are associated with a user account,
• performing, by the system, a similarity search between the at least one tag and the auto-tags to identify the embeddings that correspond to the prompt, and
• ranking, by the system, the embeddings that correspond to the prompt based on a degree of similarity between the at least one tag and the respective auto-tags, to produce ranked embeddings;
• identifying, by the system, a context based on the ranked embeddings;
• prompting, by the system, the large language model with the prompt and the context to produce a result;
• and
• making, by the system, the result available to the user account.

A non-transitory computer-readable medium comprising instructions that, in response to execution, cause a system comprising at least one processor to perform operations, comprising:

• splitting a document into chunks, wherein the splitting is performed independently of a token size, and
• splitting the chunks into embeddings;
• based on receiving a prompt to a large language model and at least one tag, wherein the prompt and the at least one tag are associated with a user account,
• performing a similarity search between the at least one tag and auto-tags that area associated with the document to identify the embeddings that correspond to the prompt, and
• ranking the embeddings that correspond to the prompt based on a degree of similarity between the at least one tag and the auto-tags, to produce ranked embeddings;
• identifying a context based on the ranked embeddings;
• inputting the prompt and the context to the large language model to produce an output;
• and
• making the output available via the user account.