Optimized large language model inference from structured data via intermediate documents
AssigneeZoom Communications, Inc.
InventorsShweta Kamble, Jatinder Kaur, Sharad Mathur
Life of this patent
Estimating the term…
Loading patent…
AssigneeZoom Communications, Inc.
InventorsShweta Kamble, Jatinder Kaur, Sharad Mathur
Estimating the term…
Techniques for optimized LLM inference from structured data via intermediate documents (“LLMs”) are disclosed. In an example method, a computing device accesses a database including a set of collections. The computing device generates one or more documents based on a first collection of the set of collections. The computing device determines one or more portions of the one or more documents based on at least one topic of the one or more documents. The computing device generates an embedded representation of each portion. The computing device receives, from a client device, a first query, including at least a first topic. The computing device determines a first portion of the one or more portions based on the first topic. The computing device generates a response based on the first query and the first portion and outputs the response to the client device.
A method, comprising:
A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations including:
A system comprising:
Dependencies are inferred from the claim text.