Systems and methods for building a customized generative artificial intelligent platform

A system for building a customized generative artificial intelligence (AI) infrastructure at an enterprise server, the system comprising:

• a memory that stores a plurality of processor executable instructions;
• a communication interface that receives a natural language processing (NLP) task request comprising a user input from a user application;
• and
• one or more hardware processors that read and execute the plurality of processor-executable instructions from the memory to perform operations comprising:
• searching a database of user-specified prompt templates based on the NLP task;
• retrieving, from a database of context features, one or more context vectors based on the NLP task request;
• populating one or more user-specified prompt templates with the retrieved one or more context vectors;
• transforming, by a data gateway, one or more generated prompts into a normalized API request comprising a parameter specifying a specific vendor and/or a specific neural network based NLP model;
• selecting the specific neural network NLP model for the customized generative AI infrastructure based on the NLP task;
• transmitting, via an AI gateway, the one or more generated prompts to the specific neural network based NLP model that is housed at a vendor server external to the enterprise server;
• receiving, via the AI gateway, a NLP response from the specific neural network based NLP model;
• and
• generating, via a user interface of the user application, a formatted output specific to the user application based on the NLP response in response to the user input.

A non-transitory machine-readable medium comprising a plurality of machine-executable instructions for building a customized generative artificial intelligence (AI) infrastructure at an enterprise server, which, when executed by one or more processors, are adapted to cause the one or more processors to perform operations comprising:

• receiving, via a communication interface, a natural language processing (NLP) task request comprising a user input from a user application;
• searching a database of user-specified prompt templates based on the NLP task;
• retrieving, from a database of context features, one or more context vectors based on the NLP task request;
• populating one or more user-specified prompt templates with the retrieved one or more context vectors;
• transforming, by a data gateway, one or more generated prompts into a normalized API request comprising a parameter specifying a specific vendor and/or a specific neural network based NLP model;
• selecting the specific neural network NLP model for the customized generative AI infrastructure based on the NLP task;
• transmitting, via an AI gateway, the one or more generated prompts to the specific neural network based NLP model that is housed at a vendor server external to the enterprise server;
• receiving, via the AI gateway, a NLP response from the specific NLP model;
• and
• generating, via a user interface of the user application, a formatted output specific to the user application based on the NLP response in response to the user input.