Data configuration, management, and testing

A non-transitory computer-readable medium storing instructions, the instructions comprising:

• one or more instructions that, when executed by one or more processors, cause the one or more processors to:
• receive an environment configuration for a data environment to be implemented in a data structure,
• wherein the environment configuration includes requirements of a plurality of applications;
• configure, based on the environment configuration, the data environment, to generate a configured data environment,
• wherein the configured data environment includes a cluster with a metadata schema, and
• wherein the configured data environment includes, in the cluster, a master container and, for each application of the plurality of applications, a servant container;
• instantiate the configured data environment in the data structure;
• perform one or more tests on data stored in the configured data environment in the data structure to generate one or more test results based on performing the one or more tests on the data,
• process the one or more test results to determine whether the metadata schema of the cluster corresponds to a metadata schema of an application of the plurality of applications;
• update, based on determining that the metadata schema of the cluster does not correspond to the metadata schema of the application, the configured data environment, to generate an updated configured data environment,
• wherein the updated configured data environment meets the requirements of the plurality of applications;
• change, based on the one or more test results, the configuration of the master container in the updated configured data environment;
• automatically change, based on changing the configuration of the master container, configurations of the servant container of each application, of the plurality of applications, in the updated configured data environment;
• perform metadata validation on the data stored in the updated configured data environment;
• and
• perform, based on the metadata validation, at least one of:
• updating a metadata field in a metadata validation log,
• stopping the metadata validation, or
• updating the metadata validation log with a failure entry.

A device, comprising:

• one or more memories;
• and
• one or more processors communicatively coupled to the one or more memories, configured to:
• receive an environment configuration for a data environment to be implemented in a data structure,
• wherein the environment configuration includes requirements of an application;
• configure, based on the environment configuration, the data environment, to generate a configured data environment,
• wherein the configured data environment includes a cluster with a metadata schema;
• instantiate the configured data environment in the data structure;
• perform one or more tests on data stored in the configured data environment in the data structure to generate one or more test results based on performing the one or more tests on the data;
• process the one or more test results to determine whether the metadata schema of the cluster corresponds to a metadata schema of the application;
• update, based on determining that the metadata schema of the cluster does not correspond to the metadata schema of the application, the configured data environment, to generate an updated configured data environment,
• wherein the updated configured data environment meets the requirements of the application;
• perform metadata validation on the data stored in the updated configured data environment;
• perform, based on the metadata validation, at least one of:
• updating a metadata field in a metadata validation log,
• stopping the metadata validation, or
• updating the metadata validation log with a failure entry;
• receive a job request for the data structure;
• and
• perform the job request in the updated configured data environment in the data structure.