Systems and methods for distributed, stateless, and persistent anonymization with variable encoding access
AssigneeIlluscio, Inc.
InventorWilliam Peake, III
Life of this patent
Estimating the term…
Abstract
Provided is an anonymization system for performing distributed, stateless, and persistent anonymization of with variable encoding. The anonymization system may receive a first file with at least a first data element. The first data element may include a tag and restricted data. The anonymization system may change a first encoding of the tag having a first size to a second encoding having a second size that is smaller than the first size. The anonymization system may replace the restricted data with different anonymized data based on a persistent mapping of the restricted data to the anonymized data, and may output the first data element with the second encoding of the tag and the anonymized data to a database or an anonymized second file.
Claims21
A method comprising:
- receiving a first file comprising at least a first data element, the first data element comprising a tag and restricted data, wherein the tag identifies a format of the restricted data;
- changing a first encoding of the tag having a first size to a second encoding having a second size that is smaller than the first size;
- determining that one or more of the tag or a format of the restricted data corresponds to a static data type;
- generating a persistent mapping by selecting anonymized data from a plurality of anonymized data using a hash of one or more of the restricted data or a unique signature of the first file;
- replacing the restricted data with the anonymized data based on the persistent mapping of the restricted data to the anonymized data;
- and
- outputting the first data element with the second encoding of the tag and the anonymized data to a database or an anonymized second file.
A system comprising:
- one or more processors configured to:
- receive a first file comprising at least a first data element, the first data element comprising a tag and restricted data, wherein the tag identifies a format of the restricted data;
- change a first encoding of the tag having a first size to a second encoding having a second size that is smaller than the first size;
- determine that one or more of the tag or a format of the restricted data corresponds to a static data type;
- generate a persistent mapping by selecting anonymized data from a plurality of anonymized data using a hash of one or more of the restricted data or a unique signature of the first file;
- replace the restricted data with the anonymized data based on the persistent mapping of the restricted data to the anonymized data;
- and
- output the first data element with the second encoding of the tag and the anonymized data to a database or an anonymized second file.
A method comprising:
- receiving a first file comprising at least a first data element, the first data element comprising a tag and restricted data, wherein the tag identifies a format of the restricted data;
- changing a first encoding of the tag having a first size to a second encoding having a second size that is smaller than the first size;
- replacing the restricted data with different anonymized data based on a persistent mapping of the restricted data to the anonymized data;
- outputting the first data element with the second encoding of the tag and the anonymized data to a database or an anonymized second file;
- receiving a third file comprising at least a second data element, the second data element comprising the tag and second data that is different than the restricted data of the first data element;
- generating a unique signature of the third file based on one or more data elements of the third file;
- retrieving the persistent mapping of the restricted data to the anonymized data based on a query comprising the unique signature of the third file and the tag, and further based on the unique signature of the third file matching the unique signature of the first file;
- adjusting the second data by an offset value that was previously used to change from the restricted data to the anonymized data, wherein the offset is defined as part of the persistent mapping;
- and
- outputting the second data element with the second encoding of the tag and the second data modified by the offset value to the database or an anonymized fourth file.
A system comprising:
- one or more processors configured to:
- receive a first file comprising at least a first data element, the first data element comprising a tag and restricted data, wherein the tag identifies a format of the restricted data;
- change a first encoding of the tag having a first size to a second encoding having a second size that is smaller than the first size;
- replace the restricted data with different anonymized data based on a persistent mapping of the restricted data to the anonymized data;
- output the first data element with the second encoding of the tag and the anonymized data to a database or an anonymized second file;
- receive a third file comprising at least a second data element, the second data element comprising the tag and second data that is different than the restricted data of the first data element;
- generate a unique signature of the third file based on one or more data elements of the third file;
- retrieve the persistent mapping of the restricted data to the anonymized data based on a query comprising the unique signature of the third file and the tag, and further based on the unique signature of the third file matching the unique signature of the first file;
- adjust the second data by an offset value that was previously used to change from the restricted data to the anonymized data, wherein the offset is defined as part of the persistent mapping;
- and
- output the second data element with the second encoding of the tag and the second data modified by the offset value to the database or an anonymized fourth file.
A method comprising:
- receiving a first file comprising at least a first data element, the first data element comprising a tag and restricted data, wherein the tag identifies a format of the restricted data;
- changing a first encoding of the tag having a first size to a second encoding having a second size that is smaller than the first size;
- replacing the restricted data with different anonymized data based on a persistent mapping of the restricted data to the anonymized data;
- outputting the first data element with the second encoding of the tag and the anonymized data to a database or an anonymized second file;
- receiving a plurality of files;
- determining a load associated with anonymizing the plurality of files;
- distributing different sets of the plurality of files to different anonymization agents;
- and
- anonymizing restricted data in each of the different sets of files with a different anonymization agent.
A system comprising:
- one or more processors configured to:
- receive a first file comprising at least a first data element, the first data element comprising a tag and restricted data, wherein the tag identifies a format of the restricted data;
- parse the tag into at least a first tag component that is encoded using a first variable type, and a second tag component that is encoded using the first variable type;
- determine a value of the first tag component is less than a threshold value, and a value of the second tag component is greater than the threshold value;
- recast the first tag component from the first variable type to a second variable type that consumes less memory than the first variable type;
- generate a second encoding of the tag with the second variable type for the first tag component, and the first variable type for the second tag component;
- replace the restricted data with different anonymized data based on a persistent mapping of the restricted data to the anonymized data;
- and
- output the first data element with the second encoding of the tag and the anonymized data to a database or an anonymized second file.
Dependencies are inferred from the claim text.