Distributed file system with disaggregated data management and storage management layers

A distributed storage system comprising:

• one or more processors;
• and
• a machine-readable medium having instructions stored thereon that when executed by the one or more processors, cause the distributed storage system to:
• deploy, virtually, a file system instance in a node of the distributed storage system, the file system instance having a dynamic configuration that at a time of deployment includes a set of services corresponding to a cluster management subsystem and a storage management subsystem, wherein the storage management subsystem performs file and data management functions and is operatable independently of a data management subsystem of the distributed storage system as a result of disaggregation of the storage management subsystem from the data management subsystem, and wherein the data management subsystem performs storage and block management functions based on requests received from an application layer;
• determine a presence of a demand for an additional service corresponding to either the data management subsystem or the storage management subsystem;
• determine that a set of resources corresponding to the additional service is available;
• and
• deploy, virtually, the additional service to meet the demand for the additional service in response to determining that the set of resources is available.

A non-transitory machine readable medium storing instructions, which when executed by one or more processors of a distributed storage system, cause the distributed storage system to:

• deploy, virtually, a file system instance in a node of a distributed storage system, the file system instance having a dynamic configuration that at a time of deployment includes a set of services corresponding to a storage management subsystem,
• wherein file and data management functions of the storage management subsystem operate independently of storage and block management functions of a data management subsystem;
• determine a presence of a demand for an additional service within the distributed storage system;
• deploy, virtually, the additional service in the node or another node of the distributed storage system to meet the demand for the additional service.