Automated scalability and performance optimization for cloud database systems using dynamic policy management

A computing system comprising:

• a processor;
• and
• a non-transitory computer-readable medium storing instructions that, when executed by the processor, cause the computing system to perform operations comprising:
• accessing a data management policy for a database, wherein the database runs on the computing system, the database includes a control table and a plurality of data tables, each data table of the plurality of data tables includes one or more data entries, and the data management policy prescribes a maximum age of data and a minimum number of future partitions for each of the plurality of data tables;
• populating the control table with control entries based on the data management policy, wherein the control entries represent the plurality of data tables;
• and
• triggering, based on a predetermined schedule, an automation package comprising:
• purging data entries from a first data table of the plurality of data tables based on the data management policy of a first control entry of the control entries, wherein the first data table corresponds to the first control entry;
• and
• generating future partitions for a second data table of the plurality of data tables based on the data management policy of a second control entry of the control entries, wherein the second data table corresponds to the second control entry.

A non-transitory computer-readable medium storing instructions that, when executed by a processor of a computing system, cause the computing system to perform operations comprising:

• accessing a first data management policy for a database, wherein the database runs on the computing system and includes a plurality of data tables, each data table of the plurality of data tables includes one or more data entries, and the first data management policy prescribes a first maximum age of data and a first minimum number of future partitions for each of the plurality of data tables;
• accessing a second data management policy for the database, wherein the second data management policy prescribes a second maximum age of data and a second minimum number of future partitions for one or more data tables of the plurality of data tables;
• populating a control table with control entries based on the first and second data management policies, wherein the populated control entries represent the plurality of data tables, and the second data management policy is prioritized over the first data management policy;
• and
• triggering, based on a predetermined schedule, an automation package comprising:
• purging data entries from a first data table of the plurality of data tables based on the populated data management policy of a first control entry of the control entries, wherein the first data table corresponds to the first control entry;
• and
• generating future partitions for a second data table of the plurality of data tables based on the populated data management policy of a second control entry of the control entries, wherein the second data table corresponds to the second control entry.