Methods and systems for automatically evaluating organizational structures and business process documentation for compliance with relevant standards, requirements, and policies

A computer system configured for evaluating application organizational structures or business process documentation against pertinent standards, requirements, or policies, comprising:

• a memory;
• and
• one or more computing devices coupled to the memory and configured with computer-executable instructions to perform operations comprising:
• receiving from a user interface one or more organizational structures or business process documents for evaluation and requested analysis or evaluation to be conducted on the one or more organizational structures or business process documents;
• transforming the received request for analysis or evaluation and the one or more organizational structures or business process documents into a format suitable for processing by a large language model (LLM);
• prompting a first LLM, which is trained to analyze organizational structures or business process documentation and the requested analysis or evaluation to identify organizational structures or business process concepts or elements that correspond to a standard, requirement or policy, to process the one or more organizational structures or business process documents and the requested analysis or evaluation to identify concepts or elements that are a subject of a standard, requirement, or policy;
• reformatting, using a compliance criteria vector database query interface module, the concepts or elements identified by the first LLM into a query suitable for presenting to an organizational structures or business process standards, requirements, and policies compliance criteria vector database, wherein the compliance criteria vector database query interface module is configured to translate the natural language concepts or elements identified by the first LLM into terminology and format compatible with the compliance criteria vector database, thereby enabling the use of a general language LLM to work with standards, requirements, and policies unique to the domain of the compliance evaluation without requiring a specialized LLM trained specifically for the domain;
• submitting the query to the organizational structures or business process standards, requirements, and policies compliance criteria vector database to identify standards, requirements, or policies that pertain to the requested analysis or evaluation;
• prompting a second LLM, which is trained to compare organizational structures or business process documentation to organizational structures or business process standards, requirements, and policies to identify compliance and non-compliance, to determine whether the one or more organizational structures or business process documents comply with each of the identified pertinent standards, requirements, or policies;
• and
• generating a report comprising outputs of the second LLM regarding compliance of the one or more organizational structures or business process documents with each of the identified pertinent standards, requirements, or policies.

A non-transitory computer-readable medium having stored thereon computer-executable instructions configured to cause one or more computing devices of a computing system to perform operations comprising:

• receiving from a user interface one or more organizational structures or business process documents for evaluation and requested analysis or evaluation to be conducted on the one or more organizational structures or business process documents;
• transforming the received request for analysis or evaluation and the one or more organizational structures or business process documents into a format suitable for processing by a large language model (LLM);
• prompting a first LLM, which is trained to analyze organizational structures or business process documentation and the requested analysis or evaluation to identify organizational structures or business process concepts or elements that correspond to a standard, requirement or policy, to process the one or more organizational structures or business process documents and the requested analysis or evaluation to identify concepts or elements that are a subject of a standard, requirement, or policy;
• reformatting, using a compliance criteria vector database query interface module, the concepts or elements identified by the first LLM into a query suitable for presenting to an organizational structures or business process standards, requirements, and policies compliance criteria vector database, wherein the compliance criteria vector database query interface module is configured to translate the natural language concepts or elements identified by the first LLM into terminology and format compatible with the compliance criteria vector database, thereby enabling the use of a general language LLM to work with standards, requirements, and policies unique to the domain of the compliance evaluation without requiring a specialized LLM trained specifically for the domain;
• submitting the query to the organizational structures or business process standards, requirements, and policies compliance criteria vector database to identify standards, requirements, or policies that pertain to the requested analysis or evaluation;
• prompting a second LLM, which is trained to compare organizational structures or business process documentation to organizational structures or business process standards, requirements, and policies to identify compliance and non-compliance, to determine whether the one or more organizational structures or business process documents comply with each of the identified pertinent standards, requirements, or policies;
• and
• generating and outputting a report comprising outputs of the second LLM regarding compliance of the one or more organizational structures or business process documents with each of the identified pertinent standards, requirements, or policies.