System and method for error-resilient data compression using codebooks

A system for error-resilient data reduction, comprising:

• a computing device comprising a memory, a processor, and a non-volatile data storage device;
• a data deconstruction engine comprising a first plurality of programming instructions stored in the memory of, and operating on a processor of, the computing device, wherein the first plurality of programming instructions, when operating on the processor, cause the computing device to:
• train an encoding algorithm on sourceblocks at multiple phases, wherein each phase comprises a distinct starting bit offset of a respective sourceblock;
• deconstruct incoming data into a plurality of sourceblocks;
• encode the sourceblocks into codewords using the encoding algorithm and a reference codebook;
• and
• send the codewords to a data reconstruction engine;
• and
• a data reconstruction engine comprising a second plurality of programming instructions stored in the memory of, and operating on a processor of, the computing device, wherein the second plurality of programming instructions, when operating on the processor, cause the computing device to:
• decode received codewords into decoded sourceblocks using the key-value pairs stored within the reference codebook;
• and
• for each decoded sourceblock, determine if the decoded sourceblock has exceeded a predetermined threshold probability that the decoded sourceblock was properly encoded, wherein the decoded sourceblock is in-phase if the threshold is exceeded and the decoded sourceblock is out-of-phase if the threshold is not exceeded.