Scale out deduplicated file system as microservices

A system for a deduplicated file system as a plurality of microservices comprising front-ends and back-ends, the system comprising:

• a processor;
• and memory configured to store one or more sequences of instructions which, when executed by the processor, cause the processor to carry out the steps of:
• balancing assignments of files in the file system across the front-ends, the files being represented by segment trees;
• balancing assignments of similarity groups across the back-ends, the similarity groups comprising segments at a lower-level of the segment trees that form the files, the front-ends being responsible for operations involving an upper-level of the segment trees, and the back-ends being responsible for operations involving the lower-level of the segment trees;
• storing a mapping of file assignments to the front-ends, and of similarity group assignments to the back-ends;
• receiving, by a load balancer, a request to perform a file system operation;
• consulting, by the load balancer, the file assignments to identify a particular front-end that should be assigned the request;
• consulting, by the particular front-end, the similarity group assignments to identify a particular back-end that should be responsible for processing segments associated with the request, the segments belonging to a similarity group that has been assigned to the particular back-end;
• and
• sending, by the particular front-end, the segments to the particular back-end.

A computer program product, comprising a non-transitory computer-readable medium having a computer-readable program code embodied therein, the computer-readable program code adapted to be executed by one or more processors to implement a method for a deduplicated file system as a plurality of microservices comprising front-ends and back-ends, the method comprising:

• balancing assignments of files in the file system across the front-ends, the files being represented by segment trees;
• balancing assignments of similarity groups across the back-ends, the similarity groups comprising segments at a lower-level of the segment trees that form the files, the front-ends being responsible for operations involving an upper-level of the segment trees, and the back-ends being responsible for operations involving the lower-level of the segment trees;
• storing a mapping of file assignments to the front-ends, and of similarity group assignments to the back-ends;
• receiving, by a load balancer, a request to perform a file system operation;
• consulting, by the load balancer, the file assignments to identify a particular front-end that should be assigned the request;
• consulting, by the particular front-end, the similarity group assignments to identify a particular back-end that should be responsible for processing segments associated with the request, the segments belonging to a similarity group that has been assigned to the particular back-end;
• and
• sending, by the particular front-end, the segments to the particular back-end.