Database query processing using a pruning index

A method comprising:

• accessing, by one or more processors, a source table organized into a set of batch units;
• generating, by the one or more processors, a pruning index based on the source table, the pruning index comprising a set of filters that index distinct values in each column of the source table, the generating of the pruning index comprising generating the set of filters, each filter in the set of filters corresponding to a batch unit in the set of batch units and being represented as an array with multiple dimensions in the pruning index;
• and
• storing, in a database, the pruning index with an association with the source table.

A computer-storage medium comprising instructions that, when executed by one or more processors of a machine, configure the machine to perform operations comprising:

• accessing a source table organized into a set of batch units;
• generating a pruning index based on the source table, the pruning index comprising a set of filters that index distinct values in each column of the source table, the generating of the pruning index comprising generating the set of filters, each filter in the set of filters corresponding to a batch unit in the set of batch units and being represented as an array with multiple dimensions in the pruning index;
• and
• storing, in a database, the pruning index with an association with the source table.