Scalable segment cleaning for a log-structured file system

A computer system for segment cleaning, the computer system comprising:

• a processor;
• and
• a non-transitory computer readable medium having stored thereon program code that upon execution causes the processor to:
• determine a first count of a plurality of segment cleaners;
• determine a first count of a plurality of virtual nodes, wherein each virtual node is associated with a plurality of objects;
• assign each virtual node of the plurality of virtual nodes to a selected one of the plurality of segment cleaners;
• determine an occurrence of one or more of the following reassignment conditions:
• the first count of the plurality of segment cleaners changing to a second count of the plurality of segment cleaners, the first count of the plurality of virtual nodes changing to a second count of the plurality of virtual nodes;
• upon determining the occurrence, for a portion, less than all, of the plurality of virtual nodes, reassign each virtual node of the portion to a newly selected segment cleaner;
• and
• perform segment cleaning according to the reassignment.

A non-transitory computer readable storage medium having stored thereon program code executable by a processor, the program code embodying a method comprising:

• determining a first count of a plurality of segment cleaners;
• determining a first count of a plurality of virtual nodes, wherein each virtual node is associated with a plurality of objects;
• assigning each virtual node of the plurality of virtual nodes to a selected one of the plurality of segment cleaners;
• determining an occurrence of one or more of the following reassignment conditions:
• the first count of the plurality of segment cleaners changing to a second count of the plurality of segment cleaners, the first count of the plurality of virtual nodes changing to a second count of the plurality of virtual nodes;
• upon determining the occurrence, for a portion, less than all, of the plurality of virtual nodes, reassigning each virtual node of the portion to a newly selected segment cleaner;
• and
• performing segment cleaning according to the reassignment.