Selective redaction of personally identifiable information in generative artificial intelligence model outputs

A system comprising:

• a model computing environment comprising at least one computing device executing a generative artificial intelligence (GenAI) model and a proxy;
• a monitoring computing environment comprising at least one computing device for monitoring the GenAI model by way of the proxy;
• wherein a combination of the model computing environment and the monitoring environment execute operations comprising:
• receiving, by the monitoring computing environment over a network from the proxy, an output of a generative artificial intelligence (GenAI) model responsive to a prompt by a requestor;
• tokenizing the output to result in a plurality of tokens;
• determining, using the tokens, that the output comprises at least one string comprising personally identifiable information (PII), the determining using pattern recognition to identify tokens and sequence of tokens indicative of PII;
• assigning, using a classifier, a PII type to each string in the output comprising PII;
• determining that at least one of the PII types in the output requires redaction;
• redacting the strings having a PII type determined to require redaction to result in a modified output;
• and
• causing the modified output to be transmitted to the requestor.

A computer-implemented method comprising:

• intercepting receiving a prompt from a requestor for ingestion by an artificial intelligence (AI) model executing in a model environment, the model environment comprising one or more computing devices;
• determining, within a monitoring environment separate from the model environment and comprising one or more computing devices, whether the prompt comprises personally identifiable information (PII);
• blocking the prompt for ingestion by the AI model when it is determined that the prompt comprises PII;
• receiving, an output of the AI model responsive to the prompt by the monitoring environment, when it is determined that the prompt does not comprise PII;
• determining, within the monitoring environment, whether the output comprises PII;
• allowing the output to be transmitted to the requestor from the model environment if it is determined that the output does not comprise PII;
• and
• selectively redacting the output before transmission from the model environment to the requestor based on a policy associated the requestor, the policy specifying levels of PII that require redaction for the requestor.