Database system with n-gram indexing

A database system comprises:

• a plurality of computing device clusters, wherein a computing device cluster of the plurality of computing device clusters includes a plurality of computing devices, wherein a computing device of the plurality of computing devices includes a plurality of computing nodes, wherein a computing node of the plurality of computing nodes includes a plurality of processing core resources, wherein a set of processing core resources of the pluralities of processing core resources of the computing device cluster is operable to:
• for a query regarding a dataset, wherein the query includes a filter clause regarding a column, wherein the column has associated n-gram indexing data, wherein the dataset includes a plurality of rows of columnar data, and wherein the column is of the columnar data;
• when the query is to be executed:
• parse the filter clause into a set of index probes in accordance with an n-gram indexing exclusion scheme and in accordance with one or more metric parameters;
• when the set of index probes provides a desired level of performance, create a plurality of input/output (IO) pipelines, wherein a first IO pipeline of the plurality of IO pipelines processes a first data portion of the dataset;
• and
• perform, by the plurality of IO pipelines, the set of index probes on data of the dataset to produce filtered data of the dataset, wherein the first IO pipeline performs the set of index probes on first data portion of the data of the dataset to produce a first filtered data portion of the filtered data.