Systems and methods for neural network safety moderators

A system for training a neural network based language model for moderating safety content, the method comprising, the system comprising:

• a memory that stores a plurality of processor executable instructions;
• a communication interface that receives a user query and a corresponding neural network generated response;
• and
• one or more hardware processors that read and execute the plurality of processor-executable instructions from the memory to perform operations comprising:
• generating, by one or more neural network based language models, a plurality of revised responses at multiple safety severity levels based on the corresponding neural network generated response and an instruction indicative of the multiple safety severity levels;
• training, the one or more neural network based language models, using a first dataset comprising the user query and the plurality of revised responses at multiple safety severity levels to generate a plurality of updated responses at a requested safety severity level;
• training, the one or more neural network based language models, using a second dataset comprising the user query, the plurality of updated responses at the requested safety severity level, to predict a severity level associated with a model-generated text;
• and
• building an artificial intelligence (AI) safety moderator agent by deploying the trained one or more neural network based language models on a hardware platform to moderate the model-generated text that is determined to be harmful.

A non-transitory machine-readable medium comprising a plurality of machine-executable instructions for training a neural network based language model for moderating safety content, which, when executed by one or more processors, are adapted to cause the one or more processors to perform operations comprising:

• receiving, via a data interface, a user query and a corresponding neural network generated response;
• generating, by one or more neural network based language models, a plurality of revised responses at multiple safety severity levels based on the corresponding neural network generated response and an instruction indicative of the multiple safety severity levels;
• training, the one or more neural network based language models, using a first dataset comprising the user query and the plurality of revised responses at multiple safety severity levels to generate a plurality of updated responses at a requested safety severity level;
• training, the one or more neural network based language models, using a second dataset comprising the user query, the plurality of updated responses at the requested safety severity level, to predict a severity level associated with a model-generated text;
• and
• building an artificial intelligence (AI) safety moderator agent by deploying the trained one or more neural network based language models on a hardware platform to moderate the model-generated text that is determined to be harmful.