Hierarchical context tree for iterative large language model prompting
AssigneeNavan, Inc.
InventorsIlan Ezra Twig, Chen Zhang, Ishay Shushu Inbar, Andrei Vodeniktov
Life of this patent
Estimating the term…
Loading patent…
AssigneeNavan, Inc.
InventorsIlan Ezra Twig, Chen Zhang, Ishay Shushu Inbar, Andrei Vodeniktov
Estimating the term…
An online system improves the development and deployment of LLM-based applications by using an agentic workflow to break down a user’s questions and determine appropriate responses. The agentic workflow includes a plurality of nodes that are connected such that the online system can traverse the workflow to narrow down a user’s intent expressed in a query. The nodes are associated with computer executable instructions that cause the online system to apply one or more large language models or perform an interfacing call with a computing system. The online system receives natural-language queries and uses the agentic workflow to determine responses to the queries. By using the agentic workflow, the online system may apply one or more LLMs to determine a response to a query with less risk of hallucinating or otherwise generating a response that does not address the query.
A method for using an agentic workflow to guide prompting of a large language model, the method comprising:
A non-transitory computer-readable medium storing computer-executable instructions that, when executed, cause a computer system to perform operations comprising:
Dependencies are inferred from the claim text.