Method and system for optimal fair distribution among buckets of different capacities

A non-transitory computer readable storage medium having instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

• dividing a distribution pattern associated with a distributed system into a plurality of segments based on a quality of distribution for the distributed system, wherein the distribution pattern comprises a plurality of partitions, wherein the distributed system comprises a plurality of buckets, and wherein a bucket of the plurality of buckets is associated with a plurality of the plurality of partitions;
• for each partition of the plurality of partitions, calculating a weight for the partition based on a number of segments in the plurality of segments and a capacity of a bucket associated with the partition;
• generating a map of partitions based on the weight for each of the plurality of partitions, wherein the map of partitions comprises a mapping of each segment in the distribution pattern to a partition that comprises the segment;
• and
• distributing a plurality of objects in the distributed system to the plurality of buckets based on the map of partitions.

A computing device comprising:

• a memory;
• and
• a processing device coupled to the memory, wherein the processing device is to:
• divide a distribution pattern associated with a distributed system into a plurality of segments based on a quality of distribution for the distributed system, wherein the distribution pattern comprises a plurality of partitions, wherein the distributed system comprises a plurality of buckets, and wherein a bucket of the plurality of buckets is associated with a plurality of the plurality of partitions;
• for each partition of the plurality of partitions, calculate a weight for the partition based on a number of segments in the plurality of segments and a capacity of a bucket associated with the partition;
• generate a map of partitions based on the weight for each of the plurality of partitions, wherein the map of partitions comprises a mapping of each segment in the distribution pattern to a partition that comprises the segment;
• and
• distribute a plurality of objects in the distributed system to the plurality of buckets based on the map of partitions.