Incremental media size extension for grid encoded data storage systems

A system, comprising at least one computing device configured to implement one or more services, wherein the one or more services are configured to:

• generate a grid of shards, the grid of shards indexed at least by a first index and a second index, the grid of shards comprising a set of data shards and a set of derived shards, wherein each shard of the grid of shards has a corresponding first index, a corresponding second index, and a corresponding storage device having a first storage capacity sufficient to store a first maximum data amount corresponding to a first shard size associated with the grid of shards and configured to store the shard, each shard configured such that the shard is reproducible from other shards associated with the first index and the shard is reproducible from other shards associated with the second index;
• determine a second maximum data amount corresponding to a second shard size associated with the grid of shards;
• pad each shard of the grid of shards with an amount of data that is based at least in part on a difference between the first storage capacity and a second storage capacity, the second storage capacity sufficient to store the second maximum data amount, the amount of data including a set of data values;
• and
• if a selected storage device corresponding to a first shard of the grid of shards is replaced with a replacement storage device having a storage capacity sufficient for the second storage capacity, replace a first set of storage devices with a second set of storage devices having a storage capacity sufficient for the second storage capacity, the storage devices in the first set of storage devices selected based at least in part on the first index of the first shard and based at least in part on the second index of the first shard.

A non-transitory computer-readable storage medium having stored thereon executable instructions that, when executed by one or more processors of a computer system, cause the computer system to at least:

• use a grid of shards, the grid of shards indexed by at least a first index and a second index, the grid of shards comprising a set of data shards and a set of derived shards, wherein each shard of the grid of shards has a corresponding first index, a corresponding second index, and a corresponding storage device, the grid of shards configured such that each shard of the grid of shards is reproducible from other shards associated with the first index and each shard of the grid of shards is reproducible from other shards associated with the second index, each corresponding storage device having a first storage capacity sufficient to store a first maximum data amount corresponding to a first shard size associated with the grid of shards,
• determine a second maximum data amount corresponding to a second shard size associated with the grid of shards and pad each shard with an amount of data that is based at least in part on a difference between the first maximum data amount and the second maximum data amount, the amount of data including a set of data values;
• replace a first storage device configured to store a first shard with a first replacement storage device configured to store the first shard, the first shard having a corresponding first index and a corresponding second index;
• and
• replace each storage device of a set of storage devices with a corresponding replacement storage device, each storage device of the set of storage devices corresponding to a derived shard in a set of derived shards, the set of derived shards including:
• a first subset of derived shards associated with the corresponding first index, the first subset having a second shard that is associated with a second index that differs from the corresponding second index;
• a second subset of derived shards associated with the corresponding second index;
• and
• a third subset of derived shards associated with the second index that differs from the corresponding second index.