Large language modules in modular programming
AssigneeIterate Studio, Inc.
InventorsBrainerd Sathianathan, Arulkumaran Chandrasekaran, Shomron Jacob
Life of this patent
Estimating the term…
Abstract
A system for creating functionality modules for deployment in a workflow for use in visual programming including a configuration server with a processing element operable to implement the functionality modules and workflow, at least one large language model, a customizable functionality module in a workflow including at least one interface defining one or more customizable properties, and wherein the workflow executes a first operational environment different from a second operational environment executed by the large language models.
Claims21
1-20. (canceled)
A system comprising:
- a processing element operable to execute a workflow;
- a shared memory configured to store a language bridge;
- and
- one or more memories configured to store:
- at least one large language module (LLM) executable in a first operational environment, the at least one LLM comprising a first LLM executable in the first operational environment;
- at least one LLM executable in a second operational environment, the at least one LLM comprising a second LLM executable in the second operational environment, the second operation environment differing from the first operational environment;
- and
- machine readable instructions, that when executed by the processing element, cause operations to be performed, the operations comprising:
- receiving at least two functionality modules into the workflow, the at least two functionality modules comprising a first functionality module comprising the first LLM and a second functionality module comprising the second LLM, wherein the first functionality module is received in a first container executing the first operational environment and the second functionality module is received in a second container executing the second operational environment that differs from the first operational environment;
- and
- transmitting, by the first functionality module and the second functionality module, communications to the shared memory and accessing, by the first functionality module and the second functionality module, communications from the shared memory, wherein the language bridge is configured to interpret the communications between the first operational environment and the second operational environment.
A method comprising:
- generating a workflow user interface displayable at a user device, the workflow user interface including nodes representative of large language models or functionality modules;
- receiving, from the workflow user interface, a first node into the executable workflow, the first node representing a first large language model;
- receiving, from the workflow user interface, a second node into the executable workflow, the second node representing a second large language model;
- receiving, from the workflow user interface, a connector into the executable workflow, the connector connecting an output of the first node to an input of the second node, the connector representing a messaging object;
- and
- automatically loading a language bridge to a shared memory accessible by the first large language model and the second large language model, the first large language model and the second large language model each configured to transmit communications to the shared memory for processing by the language bridge and access communications processed by the language bridge from the shared memory.
A system comprising:
- a processing element;
- a shared memory configured to store a language bridge;
- and
- one or more memories configured to store:
- a large language model (LLM);
- and
- instructions, that when executed by the processing element, cause operations to be performed, the operations comprising:
- receiving, from a user device, a customizable functionality module for the workflow, the customizable functionality module comprising the LLM;
- transmitting, to the user device, a user interface configured to receive one or more customizable properties associated with the customizable functionality module;
- receiving, from the user device, a customizable property associated with the LLM;
- and
- transmitting, by the customizable functionality module, first communications to the shared memory for processing by the language bridge and accessing second communications processed by the language bridge from the shared memory.
Dependencies are inferred from the claim text.