Modular Parity Caching for Data Storage And Recovery

A method for use by a system including a computing platform having a hardware processor and a system memory storing a software code, the method comprising:

• receiving, by the software code executed by the hardware processor, a dataset;
• identifying, by the software code executed by the hardware processor, a first storage medium for storing the dataset;
• determining, by the software code executed by the hardware processor, a target data size for a data subset;
• partitioning the dataset, by the software code executed by the hardware processor, into a plurality of data subsets such that (i) each of the plurality of data subsets has the target data size, and (ii) no data file included in the dataset is split between different data subsets of the plurality of data subsets;
• computing, by the software code executed by the hardware processor and using the plurality of data subsets, a parity bit for each data field occupying a same position in each of the plurality of data subsets to provide a plurality of parity bits each corresponding respectively to one data field occupying the same position in each of the plurality of data subsets;
• storing, by the software code executed by the hardware processor, each of the plurality of data subsets in the first storage medium;
• and
• storing, by the software code executed by the hardware processor, the plurality of parity bits as a parity cache in a second storage medium.