Systems and methods for adaptive data partitioning within cluster systems

A node management system, comprising:

• a cluster system comprising a plurality of nodes, wherein:
• the plurality of nodes includes a first node, and
• the first node comprises a plurality of shards, each shard comprising a plurality of volatile memory slots and a plurality of persistent storage slots;
• and
• a client device in data communication with the plurality of nodes, wherein the first node is configured to:
• identify one of the plurality of shards, and an allocation of at least one of that shard's plurality of volatile memory slots and the plurality of persistent storage slots based on a client request;
• lock the allocated at least one volatile memory slot;
• perform one or more operations, based on the client request, on the allocated at least one volatile memory slot;
• unlock the allocated at least one volatile memory slot upon completion of performing the one or more operations, wherein the one or more volatile memory slots and the one or more persistent storage slots are locked when the one or more operations are performed;
• and
• update the allocated at least one persistent storage slot based on the one or more operations performed on the at least one volatile memory slot.

A non-transitory computer-accessible medium having stored thereon computer-executable instructions, wherein upon execution by a computer arrangement comprising a processor, the instructions cause the computer arrangement to perform procedures, comprising:

• dividing a node into a plurality of shards, each shard comprising a plurality of volatile memory slots and persistent storage slots;
• identifying one of the plurality of shards, and an allocation of at least one of that shard's plurality of volatile memory slots and the plurality of persistent storage slots based on a client request;
• locking the allocated at least one volatile memory slot;
• performing one or more operations, based on the client request, on the allocated at least one volatile memory slot;
• unlocking the allocated at least one volatile memory slot upon completion of performing the one or more operations, wherein the one or more volatile memory slots and the one or more persistent storage slots are locked when the one or more operations are performed;
• and
• updating the allocated at least one persistent storage slot based on the one or more operations performed on the at least one volatile memory slot.