Universal format for multiple storage layer compatibility

A non-transitory computer readable storage medium comprising stored program code, the stored program code comprising instructions, the instructions when executed cause a processor system to:

• identify an opportunity to convert a first snapshot of a data table in a first data storage format to a second snapshot of the data table in a second data storage format, wherein the first snapshot of the data table is represented by a set of data files and is associated with one or more transactions written to one or more first metadata files;
• identify a previous snapshot of the data table in the first data storage format that was converted to a respective snapshot in the second data storage format;
• retrieve, from a storage system, a subset of the one or more first metadata files that correspond to a subset of transactions for conversion to the second data storage format, wherein the subset of transactions includes transactions occurring from the previous snapshot of the data table to the first snapshot of the data table;
• generate the second snapshot of the data table in the second data storage format, the instructions further causing the processor system to:
• use one or more library modules associated with the second data storage format to convert a sequence of actions representing the subset of transactions in the first data storage format to a sequence of equivalent actions in the second data storage format, and
• write the sequence of equivalent actions to one or more second metadata files according to the second data storage format;
• and
• store the one or more second metadata files to a file path of the storage system in conjunction with the data table.

A computer system comprising:

• a processor system;
• and
• non-transitory computer readable storage medium comprising stored program code, the stored program code comprising instructions, the instructions when executed cause a processor system to:
• identify an opportunity to convert a first snapshot of a data table in a first data storage format to a second snapshot of the data table in a second data storage format, wherein the first snapshot of the data table is represented by a set of data files and is associated with one or more transactions written to one or more first metadata files;
• identify a previous snapshot of the data table in the first data storage format that was converted to a respective snapshot in the second data storage format;
• retrieve, from a storage system, a subset of the one or more first metadata files that correspond to a subset of transactions for conversion to the second data storage format, wherein the subset of transactions includes transactions occurring from the previous snapshot of the data table to the first snapshot of the data table;
• generate the second snapshot of the data table in the second data storage format, the instructions further causing the processor system to:
• use one or more library modules associated with the second data storage format to convert a sequence of actions representing the subset of transactions in the first data storage format to a sequence of equivalent actions in the second data storage format, and
• write the sequence of equivalent actions to one or more second metadata files according to the second data storage format;
• and
• store the one or more second metadata files to a file path of the storage system in conjunction with the data table.