Systems and methods for attribute based access control on a data lake

A system comprising

• one or more processors configured to:
• receive a data file and metadata associated with the data file;
• store the data file in a database, and store the metadata associated with the data file in data catalog;
• assign the metadata a domain access configuration and an attribute access configuration;
• receive a query for the data file from a user, wherein the user is assigned a persona from a plurality of personas, each comprising a permission level;
• validate a syntax of the query;
• invoke a security administrator to evaluate access to the query through steps comprising:
• evaluating the permission level of the assigned persona against the domain access configuration;
• evaluating the permission level of the assigned persona against the attribute access configuration;
• in response to determining, by the security administrator, that the query fails to satisfy one or more of the evaluations, reject the query;
• and
• automatically testing the security administrator through steps comprising:
• entering a test state, wherein each query received by the user is rejected;
• for each persona of a specified set of the plurality of personas:
• assigning a proxy user to the persona with the corresponding permission level;
• initiating a test query for a test data file;
• invoking the security administrator to evaluate access to the test query;
• and
• generating a test result indicating whether the proxy user was impermissibly granted access to the test data file based on the permission level;
• and
• in response to one or more of the test results indicating the proxy user was impermissibly granted access to the test data file, outputting an alert.

A non-transitory computer readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to:

• receive a data file and metadata associated with the data file;
• store the data file in a database, and store the metadata associated with the data file in a data catalog;
• assign the metadata a domain access configuration and an attribute access configuration;
• receive a query for the data file from a user, wherein the user is assigned a persona from a plurality of personas, each comprising a permission level;
• validate a syntax of the query;
• invoke a security administrator to evaluate access to the query through steps comprising:
• evaluating the permission level of the assigned persona against the domain access configuration;
• evaluating the permission level of the assigned persona against the attribute access configuration;
• in response to determining, by the security administrator, that the query fails to satisfy one or more of the evaluations, reject the query;
• and
• automatically testing the security administrator through steps comprising:
• entering a test state, wherein each query received by the user is rejected;
• for each persona of a specified set of the plurality of personas:
• assigning a proxy user to the persona with the corresponding permission level;
• initiating a test query for a test data file;
• invoking the security administrator to evaluate access to the test query;
• and
• generating a test result indicating whether the proxy user was impermissibly granted access to the test data file based on the permission level;
• and
• in response to one or more of the test results indicating the proxy user was impermissibly granted access to the test data file, outputting an alert.