System and method for data compaction and security using multiple encoding algorithms

A system for encoding data using a plurality of codebooks comprising:

• a computing device comprising a processor, a memory, and a non-volatile data storage device;
• a codebook selector comprising a first plurality of programming instructions stored in the memory and operable on the processor, wherein the first plurality of programming instructions, when operating on the processor, causes the processor to:
• receive a data set for encoding, the data set comprising a plurality of sourcepackets, each sourcepacket comprising a sourcepacket identifier;
• select a list of codebooks for encoding of the data set, the list comprising a codebook identifier for each codebook;
• for each sourcepacket in the data set:
• encode the sourcepacket with each of the codebooks in the list of codebooks;
• store the most compact encoding of the sourcepacket;
• associate the sourcepacket identifier with the stored encoded sourcepacket;
• associate the codebook identifier of the codebook which produced the stored encoded sourcepacket with the sourcepacket identifier;
• and
• send the sourcepacket identifier and its associated codebook identifier to a combiner;
• and
• the combiner comprising a second plurality of programming instructions stored in the memory and operable on the processor, wherein the second plurality of programming instructions, when operating on the processor, causes the processor to:
• receive each of the sourcepacket identifiers and their associated codebook identifiers from the codebook selector;
• and
• combine the sourcepacket identifiers and their associated codebook identifiers into a data structure comprising an ordered sequence comprising each sourcepacket identifier and its associated codebook identifier.