Big data retention management system

One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to:

• parse a metastore table to extract a first table property, the metastore table having one or more time-related partitions, the first table property corresponding to a retention policy having a retention action and a first retention period;
• in response to determining that the first retention period applies to a first time-related partition of the metastore table, evaluate the first time-related partition against the first retention period;
• in response to determining that the first time-related partition is out-of-retention, create a retention event specifying the first time-related partition and the retention action;
• and
• store the retention event in a retention events database.

A computer-implemented system, comprising:

• one or more processors, and
• one or more non-transitory computer-readable media storing instructions that, when executed by the one or more processors, cause the one or more processors to:
• parse a metastore table to extract a first table property, the metastore table having one or more time-related partitions, the first table property corresponding to a retention policy having a retention action and a first retention period;
• in response to determining that the first retention period applies to a first time-related partition of the metastore table, evaluate the first time-related partition against the first retention period;
• in response to determining that the first time-related partition is out-of-retention, create a retention event specifying the first time-related partition and the retention action;
• and
• store the retention event in a retention events database.