De-tokenization patterns and solutions

An apparatus comprising:

• one or more processors;
• and
• memory storing instructions that, when executed by the one or more processors, cause the apparatus to:
• receive a request to access data stored in a tokenized file, wherein the tokenized file is arranged in a format and comprises a plurality of records, and wherein each record, of the plurality of records, comprises one or more fields;
• determine a schema associated with the tokenized file, wherein the schema identifies which of the one or more fields of each record, of the plurality of records, comprises tokenized data;
• extract instances of tokenized data from the one or more fields in the tokenized file by identifying, based on the determined schema, the instances of tokenized data;
• compile a queue of tokenized data in an order the instances of tokenized data are extracted;
• send, for processing as a batch, the queue of tokenized data to a decryption system configured to decrypt the instances of tokenized data;
• receive, from the decryption system, a queue of decrypted sensitive values corresponding to the queue of tokenized data;
• generate a de-tokenized file arranged in the format and comprising the plurality of records, wherein each instance of tokenized data, in the plurality of records, is replaced with a respective decrypted sensitive value from the queue of decrypted sensitive values;
• perform, based on a set of validation rules, a validation check on decrypted sensitive values in the de-tokenized file;
• and
• generate a validated file, arranged in the format, by adding one or more fields, indicating the results of the validation check, to the de-tokenized file.

A non-transitory computer readable medium storing computer instructions that, when executed by one or more processors, cause the one or more processors to:

• receive a request to access data stored in a tokenized file, wherein the tokenized file is arranged in a format and comprises a plurality of records, and wherein each record, of the plurality of records, comprises one or more fields;
• determine a schema associated with the tokenized file, wherein the schema identifies which of the one or more fields of each record, of the plurality of records, comprises tokenized data;
• extract instances of tokenized data from the one or more fields in the tokenized file by identifying, based on the determined schema, the instances of tokenized data;
• compile a queue of tokenized data in an order the instances of tokenized data are extracted;
• send, for processing as a batch, the queue of tokenized data to a decryption system configured to decrypt the instances of tokenized data;
• receive, from the decryption system, a queue of decrypted sensitive values corresponding to the queue of tokenized data;
• generate a de-tokenized file arranged in the format and comprising the plurality of records, wherein each instance of tokenized data, in the plurality of records, is replaced with a respective decrypted sensitive value from the queue of decrypted sensitive values;
• perform, based on a set of validation rules, a validation check on decrypted sensitive values in the de-tokenized file;
• and
• generate a validated file, arranged in the format, by adding one or more fields, indicating the results of the validation check, to the de-tokenized file.