Batch tokenization service

A computing device comprising:

• one or more processors;
• and
• memory storing instructions that, when executed by the one or more processors, cause the computing device to:
• receive a data set;
• determine a schema of the received data set;
• identify, based on a determination of the schema, one or more instances of sensitive data in the received data set;
• extract, based on identification of the one or more instances of sensitive data, the one or more instances of sensitive data from the received data set;
• determine whether a first format of a first instance of sensitive data, of the one or more instances of sensitive data, matches a known format of sensitive data;
• based on a determination that the first format of the first instance of sensitive data matches a known format of sensitive data, generate a first token corresponding to the first instance of sensitive data;
• replace the first instance of sensitive data in the received data set with the first token, wherein each of the one or more instances of sensitive data in the received data set corresponding to a known format of sensitive data is replaced by a corresponding token to generate a tokenized data set;
• determine whether a second format of a second instance of sensitive data, of the one or more instances of sensitive data, matches a known format of sensitive data;
• based on a determination that the second format of the second instance of sensitive data does not match a known format of sensitive data, store, in the tokenized set of data, an original value of the second instance of sensitive data;
• and
• store, in a data store, the tokenized data set.

A non-transitory computer-readable medium storing instructions that, when executed, configure a computing device to:

• receive a data set;
• determine a schema of the received data set;
• identify, based on a determination of the schema, one or more instances of sensitive data in the received data set;
• extract, based on identification of the one or more instances of sensitive data, the one or more instances of sensitive data from the received data set;
• determine whether a first format of a first instance of sensitive data, of the one or more instances of sensitive data, matches a known format of sensitive data;
• based on a determination that the first format of the first instance of sensitive data matches a known format of sensitive data, generate a first token corresponding to the first instance of sensitive data;
• replace the first instance of sensitive data in the received data set with the first token, wherein each of the one or more instances of sensitive data in the received data set corresponding to a known format of sensitive data is replaced by a corresponding token to generate a tokenized data set;
• determine whether a second format of a second instance of sensitive data, of the one or more instances of sensitive data, matches a known format of sensitive data;
• based on a determination that the second format of the second instance of sensitive data does not match a known format of sensitive data, store, in the tokenized set of data, an original value of the second instance of sensitive data;
• and
• store, in a data store, the tokenized data set.