Method and System for Optimizing Use of Retrieval Augmented Generation Pipelines in Generative Artificial Intelligence Applications
AssigneeVijay Madisetti
InventorsVijay Madisetti, Arshdeep Bahga
Life of this patent
Estimating the term…
Abstract
A method for generating targeted advertisements LLM systems including receiving a user query, identifying categories of information by analyzing the user query using modeling techniques, generating derived queries from the user query, generating query responses by processing the user query and the derived queries through h-LLMs, determining advertisement content based on the categories of information and a user intention or a user attitude, generating targeted advertisements responsive to the advertisement content, and creating an advertisement-enhanced response by integrating the advertisements with the query responses.
Claims24
A method for generating targeted advertisements in large language model (LLM) systems comprising:
- receiving a user query at an AI input broker from a user;
- identifying one or more categories of information by analyzing the user query using one or more topic modeling techniques;
- generating one or more derived queries from the user query to identify at least one of a user intention and a user attitude;
- generating a plurality of query responses by processing the user query and the one or more derived queries through one or more families of LLMs (h-LLMs);
- determining advertisement content based on the one or more categories of information and the user intention or the user attitude;
- generating one or more targeted advertisements responsive to the advertisement content;
- and
- creating an advertisement-enhanced response by integrating the one or more targeted advertisements with the plurality of query responses.
A system for generating targeted advertisements in large language model (LLM) systems comprising:
- a processor;
- a communication device operably coupled to the processor and operable to transmit and receive messages across a digital network;
- and
- a non-transitory computer-readable storage medium having software stored thereon that, when executed by the processor, is operable to:
- operate an AI input broker operable to receive a user query;
- identify one or more categories of information by analyzing the user query using one or more topic modeling techniques;
- generate one or more derived queries from the user query to identify at least one of a user intention and a user attitude;
- generate a plurality of query responses by processing the user query and the one or more derived queries through one or more families of LLMs (h-LLMs);
- determine advertisement content based on the one or more categories of information and the user intention or the user attitude;
- generate one or more targeted advertisements responsive to the advertisement content;
- and
- create an advertisement-enhanced response by integrating the one or more targeted advertisements with the plurality of query responses.
A system for generating targeted advertisements in large language model (LLM) systems comprising:
- means for operating an AI input broker operable to receive a user query at an AI input broker from a user;
- means for identifying one or more categories of information by analyzing the user query using one or more topic modeling techniques;
- means for generating one or more derived queries from the user query to identify at least one of a user intention and a user attitude;
- means for generating a plurality of query responses by processing the user query and the one or more derived queries through one or more families of LLMs (h-LLMs);
- means for determining advertisement content based on the one or more categories of information and the user intention or the user attitude;
- means for generating one or more targeted advertisements responsive to the advertisement content;
- and
- means for creating an advertisement-enhanced response by integrating the one or more targeted advertisements with the plurality of query responses.
A system for generating targeted advertisements in LLM systems comprising:
- an AI input broker configured to:
- receive a user query from a user;
- identify at least one intention identification from the user query;
- and
- generate one or more derived queries based on the at least one intention identification;
- a topic modeling engine configured to identify one or more advertisement-relevant categories relevant to the user query;
- an advertisement generation module configured to create one or more targeted advertisements based on an advertisement-relevant category of the one or more advertisement-relevant categories and an intention identification of the at least one intention identification;
- a bidding system interface configured to receive a plurality of advertisement bids from a plurality of advertisers for a plurality of content categories comprising the one or more advertisement-relevant categories;
- and
- an advertisement integration module configured to combine the one or more targeted advertisements with one or more LLM-generated responses generated responsive to the user query.
Dependencies are inferred from the claim text.