Systems and methods for management of multi-tenancy data analytics platforms

A data storage method, comprising:

• creating, in response to instructions received from a user, a first pipeline configured to:
• extract data from an append-only first data store;
• extract identifying characteristics from the extracted data;
• provide the identifying characteristics to an identity service;
• receive a tenancy identifier from the identity service;
• create a data object in a second data store using the extracted data;
• create a tenancy object in a metadata store, the tenancy object associated with the data object, the metadata store implementing a hierarchical data object ownership graph;
• and
• associate the tenancy object with a parent object in the hierarchical data object ownership graph;
• and
• tearing down the first pipeline following completion of creation of the data object, creation of the tenancy object, and association of the tenancy object with the parent object.

A non-transitory computer-readable medium containing instructions that, when executed by at least one processor of a data analytics system, cause the data analytics system to perform operations comprising:

• creating, in response to instructions received from a user, a first pipeline configured to:
• extract data from an append-only first data store, the extracted data received from a client;
• extract identifying characteristics from the extracted data, the identifying characteristics comprising an organization code contained in the extracted data;
• provide the identifying characteristics to an identity service;
• receive a tenancy identifier from the identity service;
• create a data object in a second data store using the extracted data;
• create a tenancy object in a metadata store, the tenancy object associated with the data object, the metadata store implementing a hierarchical data object ownership graph, the hierarchical data object ownership graph enabling a user permitted to access a parent object in the hierarchical data object ownership to access data objects associated with all child tenancies of the parent object in the hierarchical data object ownership graph;
• and
• associate the tenancy object with a parent object in the hierarchical data object ownership graph;
• and
• tearing down the first pipeline following completion of creation of the data object, creation of the tenancy object, and association of the tenancy object with the parent object.