Distributed object placement, replication, and retrieval for cloud-scale storage and data delivery

A system comprising:

• one or more processors;
• and
• at least one computer-readable storage medium having stored therein instructions which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
• receiving, at a dispatcher of a storage system, a request for an object from a client;
• identifying, by the dispatcher, candidate storage nodes of the storage system for serving the object to the client by generating an ordered list of the candidate storage nodes using a two-dimensional consistent hashing function that depends on both a flow associated with the request for the object and the object itself;
• and
• facilitating distribution of the request for the object through one or more candidate storage nodes of the candidate storage nodes according to the ordered list of the candidate storage nodes for filling the request for the object, wherein the one or more candidate storage nodes are configured to facilitate the distribution of the request for the object by selectively filling the request for the object to the client using cache admission policies formed based on popularity characteristics of requested objects at the one or more candidate storage nodes and the one or more candidate storage nodes are configured to selectively replicate the object across at least a portion of the candidate storage nodes based on selectively filing the request for the object.

A non-transitory computer-readable storage medium having stored therein instructions which, when executed by a processor, cause the processor to perform operations comprising:

• receiving, at a dispatcher of a storage system, a request for an object from a client;
• identifying, by the dispatcher, candidate storage nodes of the storage system for serving the object to the client by generating an ordered list of the candidate storage nodes using a two-dimensional consistent hashing function that depends on both a flow associated with the request for the object and the object itself;
• and
• facilitating distribution of the request for the object through one or more candidate storage nodes of the candidate storage nodes according to the ordered list of the candidate storage nodes for filling the request for the object, wherein the dispatcher is configured to facilitate the distribution of the request for the object by transmitting the request for the object to a first candidate storage node in the ordered list of the candidate storage nodes and the one or more candidate storage nodes are configured to facilitate the distribution of the request for the object by selectively filling the request for the object to the client using cache admission policies formed based on popularity characteristics of requested objects at the one or more candidate storage nodes.