Storing metadata using data structures in database systems

A method comprising:

• receiving first metadata corresponding to a set of micro-partitions;
• storing a first data structure and a second data structure in storage as a first file and a second file, first data structure including the first metadata and a second data structure including second metadata, the first metadata corresponding to a set of micro-partitions, the second metadata for a grouping of the first metadata, the second data structure including information associating the second metadata to the first metadata;
• and
• storing third metadata for a table, the third metadata comprising:
• cumulative table metadata comprising global information about a plurality of micro-partitions of the table, the cumulative table metadata being stored in a single metadata micro-partition associated with the table, the single metadata micro-partition being separate from the plurality of micro-partitions of the table, the single metadata micro-partition including information comprising at least a list of all added table data micro-partitions.

A non-transitory computer-readable medium comprising instructions that, when executed by at least one processor, configure the at least one processor to perform operations comprising:

• receiving first metadata corresponding to a set of micro-partitions;
• storing a first data structure and a second data structure in storage as a first file and a second file, first data structure including the first metadata and a second data structure including second metadata, the first metadata corresponding to a set of micro-partitions, the second metadata for a grouping of the first metadata, the second data structure including information associating the second metadata to the first metadata;
• and
• storing third metadata for a table, the third metadata comprising:
• cumulative table metadata comprising global information about a plurality of micro-partitions of the table, the cumulative table metadata being stored in a single metadata micro-partition associated with the table, the single metadata micro-partition being separate from the plurality of micro-partitions of the table, the single metadata micro-partition including information comprising at least a list of all added table data micro-partitions.