Rule-based document scrubbing of sensitive data

A system comprising:

• one or more processors;
• and a memory;
• one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs include instructions that:
• obtain a plurality of documents having telemetric data and sensitive data, a first set of the plurality of documents having a plurality of fields arranged in a first format, a second set of the plurality of documents having a plurality of fields arranged in a second format, wherein the first format and the second format differ;
• access a script having a plurality of rules, a rule identifying a select one of the plurality of fields of a select one of the plurality of documents of a specific format as sensitive data and including a scrubbing action;
• apply the plurality of rules of the script to each of the plurality of documents to identify sensitive data and to associate a scrubbing action for the identified sensitive data;
• tag each of the plurality of documents with a tag indicating the scrubbing action from the application of the plurality of rules;
• aggregate select ones of the plurality of documents tagged with a similar tag;
• perform a select scrubbing action associated with the similar tag to each of the selected aggregated documents;
• and
• process the telemetric data without the sensitive data.