US 2026/0288784 A1Published application

System and Method for Configuring Workflows with Multiple Large Language Models

AssigneeMakebell Limited

InventorsKaidrian Yu, Ronald Yu

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method and system for configuring workflows using multiple large language models (LLMs) includes receiving configuration settings for multiple modules including user message modules, LLM processing modules, search modules, and presentation modules. The system assigns global and local unique identifications to each module and defines data flow between modules using a flowchart. The method includes validating LLM outputs against predefined schemas and automatically correcting non-conforming outputs using additional LLM processing. The system generates debug information for each module and manages sensitive information through dedicated removal modules. Database schemas are dynamically generated based on document analysis, enabling efficient storage and retrieval of processed information across multiple specialized databases. The system provides configurable user interfaces adaptable for different professional applications while maintaining consistent output quality through automated validation processes.

Claims20

Dependent claims

A method of configuring a computing system to generate a report using a large language model (LLM), comprising:

a) receiving a message module configuration for a user message module, wherein the user message module is configured to receive user messages;
wherein the message module configuration comprises a message order identification and a message string;
b) receiving LLM processing module configurations for a plurality of LLM processing modules, wherein each LLM processing module is individually configured to send prompts to an LLM engine and receive responses;
wherein a LLM processing module configuration comprises a LLM processing module identification, a LLM processing module output format type and LLM processing module output format schema;
c) receiving search module configurations for a plurality of search modules, wherein each search module is individually configured to retrieve documents from a database;
wherein a search module configuration comprises identification of a database and maximum of number of search results;
d) receiving a configuration for at least one presentation module, wherein the presentation module is configured to combine the outputs from at least one search module and at least one LLM processing module;
wherein a presentation module configuration comprises identification of the at least one search module and identification of at least one LLM processing module;
e) receiving a flowchart configuration defining the message pathways among the user message module, the LLM processing modules, the search modules, and the presentation module;
f) configuring the computing system to execute the flowchart, wherein the user message module, the LLM processing modules, the search modules, and the presentation module work in coordination to generate the report;
g) when outputs from the at least one LLM processing module does not conform to the LLM processing module output format schema, configuring the computing system to modify the outputs from the at least one LLM processing module to conform to the LLM processing module output format schema.

8 more elements

A computing system for generating a report using a large language model (LLM), comprising:

a) a processor;
and
b) a memory storing instructions that, when executed by the processor, cause the computing system to perform operations comprising:
i. receiving a message module configuration for a user message module, wherein the user message module is configured to receive user messages;
wherein the message module configuration comprises a message order identification and a message string;
ii. receiving LLM processing module configurations for a plurality of LLM processing modules, wherein each LLM processing module is individually configured to send prompts to an LLM engine and receive responses;
wherein a LLM processing module configuration comprises a LLM processing module identification, a LLM processing module output format type and LLM processing module output format schema;
iii. receiving search module configurations for a plurality of search modules, wherein each search module is individually configured to retrieve documents from a database;
wherein a search module configuration comprises identification of a database and maximum of number of search results;
iv. receiving a configuration for at least one presentation module, wherein the presentation module is configured to combine the outputs from at least one search module and at least one LLM processing module;
wherein a presentation module configuration comprises identification of the at least one search module and identification of at least one LLM processing module;
v. receiving a flowchart configuration defining the message pathways among the user message module, the LLM processing modules, the search modules, and the presentation module;
vi. configuring the computing system to execute the flowchart, wherein the user message module, the LLM processing modules, the search modules, and the presentation module work in coordination to generate the report;
and
vii. when outputs from the at least one LLM processing module do not conform to the LLM processing module output format schema, configuring the computing system to modify the outputs from the at least one LLM processing module to conform to the LLM processing module output format schema.

12 more elements

Dependencies are inferred from the claim text.