Systems and methods for aligning large multimodal models (LMMs) or large language models (LLMs) with domain-specific principles

A system, comprising:

• a computer system having a processor;
• a plurality of lines of instructions that are executed by the processor, the processor being configured to:
• receive, by a computer having an artificial intelligence model being one of a large language model and a large multimodal model from a computing device, a prompt from a user of the computing device for a response from the artificial intelligence;
• align each response from the trained artificial intelligence model with one or more principles for a particular domain to generate an aligned response, wherein the processor configured to align each response is further configured to select two or more instruction generators for the particular domain wherein each instruction generator is one of a retrieval augmented generator, an API-based generator, a weak labeling generator and a synthetic instruction generator, generate a plurality of instructions aligned with the one or more principles for the particular domain from the two or more instructions generators, aggregate the plurality of instructions for the two or more instruction generators into a final plurality of instructions aligned with the one or more principles for the particular domain, train the artificial intelligence model using the final plurality of instructions aligned with the one or more principles for the particular domain to generate an aligned artificial intelligence model and generating, using the aligned artificial intelligence model, the aligned response to the user prompt;
• and
• return, to the computing device, the aligned response to the user prompt.