Static Approach to Lazy Materialization in Database Scans Using Pushed Filters

A non-transitory computer readable storage medium comprising stored instructions, the stored instructions comprising instructions that when executed causes at least one processor to:

• receive a request to perform a query in a columnar database having a plurality of columns;
• identify, based on the query, a filter column and a non-filter column of the plurality of columns;
• access, from an object storage, a first task comprising a first set of contiguous rows in the filter column;
• apply a filter defined by the query to the first task to generate filter results that are analyzed for performance characteristics of the filter results;
• generate, from the performance characteristics analyzed, a likelihood value indicating a likelihood of gaining a performance benefit by applying a lazy materialization technique to a second task of the query associated with a second set of contiguous rows of the filter column;
• compare the likelihood value to a threshold value;
• and
• apply the lazy materialization technique to the second task responsive to the likelihood value meeting or exceeding the threshold value.

A system comprising:

• at least one processor;
• a memory communicatively coupled with the at least one processor, the memory comprising stored instructions, the stored instructions comprising instructions that when executed causes the at least one processor to:
• receive a request to perform a query in a columnar database having a plurality of columns;
• identify, based on the query, a filter column and a non-filter column of the plurality of columns;
• access, from an object storage, a first task comprising a first set of contiguous rows in the filter column;
• apply a filter defined by the query to the first task to generate filter results that are analyzed for performance characteristics of the filter results;
• generate, from the performance characteristics analyzed, a likelihood value indicating a likelihood of gaining a performance benefit by applying a lazy materialization technique to a second task of the query associated with a second set of contiguous rows of the filter column;
• compare the likelihood value to a threshold value;
• and
• apply the lazy materialization technique to the second task responsive to the likelihood value meeting or exceeding the threshold value.