Back to results
US 12,019,663 B1Granted
Utilizing a large language model to perform a query
AssigneeTiny Fish Inc.
InventorsShuhao Zhang, Qi Zhai, Mingyang Li
Life of this patent
Estimating the term…
Abstract
A query is received from a client device. A large language model is prompted to generate a plurality of subtopics on the query and to generate a corresponding plurality of keywords for each of the plurality of subtopics. One or more search engines are utilized to perform a plurality of searches utilizing the plurality of subtopics and the corresponding plurality of keywords received from the large language model. A plurality of responses corresponding to the plurality of subtopics and the corresponding plurality of keywords is received from the one or more search engines. The plurality of responses is evaluated based on the corresponding plurality of keywords.
Claims20
A method, comprising:
- receiving from a client device a query;
- providing to a large language model a prompt to generate a plurality of subtopics on the query and to generate a corresponding plurality of keywords for each of the plurality of subtopics, wherein the prompt includes a user-specified number for the subtopics and a user-specified number of the keywords for each of the plurality of subtopics;
- receiving from the large language model the plurality of subtopics and the corresponding plurality of keywords for each of the plurality of subtopics;
- utilizing one or more search engines to perform a plurality of searches utilizing the plurality of subtopics and the corresponding plurality of keywords received from the large language model;
- receiving from the one or more search engines a plurality of responses corresponding to the plurality of subtopics and the corresponding plurality of keywords;
- evaluating the plurality of responses based on the corresponding plurality of keywords to determine a subset of the plurality of the responses;
- extracting information included in the subset of the plurality of the responses to determine a corresponding subset of sentences associated with each of the plurality of subtopics;
- providing to the large language model the received query and the corresponding subset of sentences associated with each of the plurality of subtopics;
- and
- receiving a query response from the large language model that is generated based on the received query and the corresponding subset of sentences associated with each of the plurality of subtopics.
7 more elements
A system, comprising:
- a processor configured to:
- receive from a client device a query;
- provide to a large language model a prompt to generate a plurality of subtopics on the query and to generate a corresponding plurality of keywords for each of the plurality of subtopics, wherein the prompt includes a user-specified number for the subtopics and a user-specified number of the keywords for each of the plurality of subtopics;
- receive from the large language model the plurality of subtopics and the corresponding plurality of keywords for each of the plurality of subtopics;
- utilize one or more search engines to perform a plurality of searches utilizing the plurality of subtopics and the corresponding plurality of keywords received from the large language model;
- receive from the one or more search engines a plurality of responses corresponding to the plurality of subtopics and the corresponding plurality of keywords;
- evaluate the plurality of responses based on the corresponding plurality of keywords to determine a subset of the plurality of the responses;
- extract information included in the subset of the plurality of the responses to determine a corresponding subset of sentences associated with each of the plurality of subtopics;
- provide to the large language model the received query and the corresponding subset of sentences associated with each of the plurality of subtopics;
- and
- receive a query response from the large language model that is generated based on the received query and the corresponding subset of sentences associated with each of the plurality of subtopics;
- and
- a memory coupled to the processor and configured to provide the processor with instructions.
10 more elements
A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:
- receiving from a client device a query;
- providing to a large language model a large language model prompt to generate a plurality of subtopics on the query and to generate a corresponding plurality of keywords for each of the plurality of subtopics, wherein the large language model prompt includes a user-specified number for the subtopics and a user-specified number of the keywords for each of the plurality of subtopics;
- receiving from the large language model the plurality of subtopics and the corresponding plurality of keywords for each of the plurality of subtopics;
- utilizing one or more search engines to perform a plurality of searches utilizing the plurality of subtopics and the corresponding plurality of keywords received from the large language model;
- receiving from the one or more search engines a plurality of responses corresponding to the plurality of subtopics and the corresponding plurality of keywords;
- evaluating the plurality of responses based on the corresponding plurality of keywords to determine a subset of the plurality of the responses;
- extracting information included in the subset of the plurality of the responses to determine a corresponding subset of sentences associated with each of the plurality of subtopics;
- providing to the large language model the received query and the corresponding subset of sentences associated with each of the plurality of subtopics;
- and
- receiving a query response from the large language model that is generated based on the received query and the corresponding subset of sentences associated with each of the plurality of subtopics.
7 more elements
Dependencies are inferred from the claim text.