Generative artificial intelligence (AI) integration tool
AssigneeFreshworks Inc.
InventorsRamesh Parthasarathy, Bruno Da Silva Bozza, Vijay Raajaa
Life of this patent
Estimating the term…
Abstract
A system architecture configured to integrate with a plurality of generative artificial intelligence (AI) implementations across public and private cloud-based platforms. More specifically, the system provides a multitenant, cloud-based platform for building machine learning (ML) endpoints using low level generative AI models.
Claims17
A system configured to integrate an artificial intelligence (AI) platform across a plurality of customer relationship management (CRM) applications, comprising:
- at least one processor;
- and
- memory comprising a set of instructions, wherein
- the set of instructions are configured to cause at least one processor to execute
- receive a prompt and a plurality of user-provided functions, wherein the plurality of user-provided functions include values computed for a model from a set of large language models (LLMs) and the received prompt;
- and
- dynamically routing user instructions comprising the prompt across the set of LLMs hosted by one or more cloud-based providers, wherein
- the dynamically routing of the user instructions comprises
- dynamically switching from one of the one or more cloud-based providers to another one of the one or more cloud-based providers when the one of the one or more cloud-based providers encounters an error.
A computer-implemented method integrating an artificial intelligence (AI) platform across a plurality of customer relationship management (CRM) applications, comprising:
- receiving a prompt and a plurality of user-provided functions, wherein the plurality of user-provided functions include values computed for a model from a set of large language models (LLMs) and the received prompt;
- and
- dynamically routing user instructions comprising the prompt across the set of LLMs hosted by one or more cloud-based providers, wherein
- the dynamically routing of the user instructions comprises
- dynamically switching from one of the one or more cloud-based providers to another one of the one or more cloud-based providers when the one of the one or more cloud-based providers encounters an error.
The computer-implemented method of 11, further comprising:
- determining the model from the set of LLMs using a plurality of varied prompts, LLM model utilization costs, outcome accuracies, and latencies, to generate a regression score.
A non-transitory computer-readable medium configured to integrate an artificial intelligence (AI) platform across a plurality of customer relationship management (CRM), wherein the non-transitory computer-readable medium comprising a computer program, the computer program is configured to cause at least one processor to execute:
- receiving a prompt and a plurality of user-provided functions, wherein the plurality of user-provided functions include values computed for a model from a set of large language models (LLMs) and the received prompt;
- and
- dynamically routing user instructions comprising the prompt across the set of LLMs hosted by one or more cloud-based providers, wherein
- the dynamically routing of the user instructions comprises
- dynamically switching from one of the one or more cloud-based providers to another one of the one or more cloud-based providers when the one of the one or more cloud-based providers encounters an error.
Dependencies are inferred from the claim text.