Method and apparatus for low delay access to key-value based storage systems using FEC techniques

An apparatus for use in a key-value based storage system, the apparatus comprising:

• a communication interface for coupling to a network, the communication interface operable to receive an object from the network;
• a memory coupled to the communication interface to store the object;
• and
• a processor coupled to the memory and the communication interface, the processor operable to
• divide the object into K portions, where K is an integer,
• select an erasure coding to apply to the K portions as a function of delay performance of the key-value based storage system, by, at least in part, determining a number of parity blocks to generate to satisfy one or both of a delay target of putting the object into the key-value store and a delay target of subsequent read requests, where both delay targets are based on an offline performance simulation of delay performance when different numbers of parity blocks are used given the delay distributions obtained through measurements for different request types and object sizes;
• and
• apply the erasure coding to the K portions to create N blocks of data;
• and wherein the processor operates with the communication interface to send the N blocks of data using separate transfers to the storage system.

An article of manufacture having one or more non-transitory computer readable storage media storing instructions which, when executed by a system, causes the system to perform a method comprising:

• dividing an object into K portions, where K is an integer;
• selecting an erasure coding to apply to the K portions as a function of delay performance of a key-value based storage system, including determining a number of parity blocks to generate to satisfy one or both of a delay target of putting the object into the key-value store and a delay target of subsequent read requests, where both delay targets are based on an offline performance simulation of delay performance when different numbers of parity blocks are used given the delay distributions obtained through measurements for different request types and object sizes;
• applying the erasure coding to the K portions to create N blocks of data;
• and
• sending the N blocks of data using separate transfers to the storage system.