Utilizing a large language model to perform a query
AssigneeTiny Fish Inc.
InventorsShuhao Zhang, Qi Zhai, Mingyang Li
Life of this patent
Estimating the term…
Abstract
A query is received from a client device. A large language model is prompted to generate a plurality of subtopics on the query and to generate a corresponding plurality of keywords for each of the plurality of subtopics. One or more search engines are utilized to perform a plurality of searches utilizing the plurality of subtopics and the corresponding plurality of keywords received from the large language model. A plurality of responses corresponding to the plurality of subtopics and the corresponding plurality of keywords is received from the one or more search engines. The plurality of responses is evaluated based on the corresponding plurality of keywords.
Claims23
A method, comprising:
- receiving from a client device a query;
- providing to a large language model a prompt to generate a plurality of subtopics on the query and to generate a corresponding plurality of keywords for each of the plurality of subtopics;
- utilizing one or more search engines to perform a plurality of searches utilizing the plurality of subtopics and the corresponding plurality of keywords received from the large language model;
- receiving from the one or more search engines a plurality of responses corresponding to the plurality of subtopics and the corresponding plurality of keywords;
- evaluating the plurality of responses based on the corresponding plurality of keywords;
- providing to the large language model the received query and a corresponding subset of sentences associated with each of the plurality of subtopics selected from a subset of the plurality of responses;
- receiving a query response from the large language model that is generated based on the received query and the corresponding subset of sentences associated with each of the plurality of subtopics selected from the subset of the plurality of responses;
- and
- providing to the client device the query response that includes a plurality of links to sources that were used by the large language model to generate the large language model query response.
A system, comprising:
- a processor configured to:
- receive from a client device a query;
- provide to a large language model a prompt to generate a plurality of subtopics on the query and to generate a corresponding plurality of keywords for each of the plurality of subtopics;
- utilize one or more search engines to perform a plurality of searches utilizing the plurality of subtopics and the corresponding plurality of keywords received from the large language model;
- receive from the one or more search engines a plurality of responses corresponding to the plurality of subtopics and the corresponding plurality of keywords;
- evaluate the plurality of responses based on the corresponding plurality of keywords;
- provide to the large language model the received query and a corresponding subset of sentences associated with each of the plurality of subtopics selected from a subset of the plurality of responses;
- receive a query response from the large language model that is generated based on the received query and the corresponding subset of sentences associated with each of the plurality of subtopics selected from the subset of the plurality of responses;
- and
- provide to the client device the query response that includes a plurality of links to sources that were used by the large language model to generate the large language model query response;
- and
- a memory coupled to the processor and configured to provide the processor with instructions.
A computer program product embodied in a non-transitory computer readable medium and comprising computer instructions for:
- receiving from a client device a query;
- providing to a large language model a prompt to generate a plurality of subtopics on the query and to generate a corresponding plurality of keywords for each of the plurality of subtopics;
- utilizing one or more search engines to perform a plurality of searches utilizing the plurality of subtopics and the corresponding plurality of keywords received from the large language model;
- receiving from the one or more search engines a plurality of responses corresponding to the plurality of subtopics and the corresponding plurality of keywords;
- evaluating the plurality of responses based on the corresponding plurality of keywords;
- providing to the large language model the received query and a corresponding subset of sentences associated with each of the plurality of subtopics selected from a subset of the plurality of responses;
- receiving a query response from the large language model that is generated based on the received query and the corresponding subset of sentences associated with each of the plurality of subtopics selected from the subset of the plurality of responses;
- and
- providing to the client device the query response that includes a plurality of links to sources that were used by the large language model to generate the large language model query response.
Dependencies are inferred from the claim text.