Methods and Apparatuses for Balancing Utilization of Computer Resources

A method of balancing resource utilization among a set of servers, the method comprising:

• determining a system state for the set of servers, wherein some of the servers in the set may be unavailable, the system state being defined by the subset of servers that are currently available from among the set of servers, and wherein the number of possible system states is the number of unique subsets of servers from among the set of servers;
• assigning individual shards to respective ones among the subset of available servers according to a shard-to-server allocation scheme that, at least for mapped ones of the possible system states, prescribes an allocation of the shards among the subset of servers belonging to each mapped system state and minimizes the number of shard reassignments needed when the system state changes, wherein each shard is one among a set of shards and comprises a logical container for objects, and wherein each object comprises a job object or a storage object that requires respective resources on the server to which the object is assigned;
• allocating new objects incoming to the set of servers for processing to respective ones of the shards according to an object-to-shard allocation scheme that balances resource requirements across the shards;
• and
• responsive to the system state changing from a first one of the mapped system states to a second one of the mapped system states, reassigning individual ones of the shards from one server to another, as needed, in view of the differences between the shard-to-server assignments prescribed by the shard-to-server allocation scheme for the first and second mapped system states.

A computer processing apparatus operative to balance resource utilization among a set of servers, the computer processing apparatus comprising:

• interface circuitry;
• and
• processing circuitry configured to communicate via the interface circuitry and, based on such communications:
• determine a system state for the set of servers, wherein some of the servers in the set may be unavailable, the system state being defined by the subset of servers that are currently available from among the set of servers, and wherein the number of possible system states is the number of unique subsets of servers from among the set of servers;
• assign individual shards to respective ones among the subset of available servers according to a shard-to-server allocation scheme that, at least for mapped ones of the possible system states, prescribes a defined allocation of the shards among the subset of servers belonging to each mapped system state and minimizes the number of shard reassignments needed when the system state changes, wherein each shard is one among a set of shards and comprises a logical container for objects, and wherein each object comprises a job object or a storage object that requires respective resources on the server to which the object is assigned;
• allocate new objects incoming to the set of servers for processing to respective ones of the shards according to an object-to-shard allocation scheme that balances resource requirements across the shards;
• and
• responsive to the system state changing from a first one of the mapped system states to a second one of the mapped system states, reassign individual ones of the shards from one server to another, as needed, in view of the differences between the shard-to-server assignments prescribed by the shard-to-server allocation scheme for the first and second mapped system states.

A computer-readable medium storing a computer program comprising program instructions that, when executed by processing circuitry of a computer processing apparatus, configures the computer processing apparatus to balance resource utilization among a set of servers, the computer program comprising program instructions causing the computer processing apparatus to:

• determine a system state for the set of servers, wherein some of the servers in the set may be unavailable, the system state being defined by the subset of servers that are currently available from among the set of servers, and wherein the number of possible system states is the number of unique subsets of servers from among the set of servers;
• assign individual shards to respective ones among the subset of available servers according to a shard-to-server allocation scheme that, at least for mapped ones of the possible system states, prescribes a defined allocation of the shards among the subset of servers belonging to each mapped system state and minimizes the number of shard reassignments needed when the system state changes, wherein each shard is one among a set of shards and comprises a logical container for objects, and wherein each object comprises a job object or a storage object that requires respective resources on the server to which the object is assigned;
• allocate new objects incoming to the set of servers for processing to respective ones of the shards according to an object-to-shard allocation scheme that balances resource requirements across the shards;
• and
• responsive to the system state changing from a first one of the mapped system states to a second one of the mapped system states, reassigning individual ones of the shards from one server to another, as needed, in view of the differences between the shard-to-server assignments prescribed by the shard-to-server allocation scheme for the first and second mapped system states.