Performance improvement in data visualization filters

A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations comprising:

• receiving a document, the document comprising visualization metadata for a data visualization of a data set and data set metadata comprising information of all columns of the data set, wherein the visualization metadata comprises information of all the columns of the data set present in a data visualization and indicates a mapping between the columns and vertical bars displayed relative to a horizontal axis and a vertical axis of the data visualization, and wherein the data set comprises a plurality of data columns, each of the plurality of data columns has a column name and a plurality of data values, and a first set of columns of the plurality of data columns is displayed by the data visualization;
• determining the first set of columns displayed by the data visualization based on the visualization metadata;
• determining a second set of columns of the plurality of data columns that are excluded from the data visualization, wherein the second set of columns comprises remaining columns of the plurality of data columns excluding the first set of columns;
• generating an ordered data set by having the first set of columns prior to the second set of columns;
• generating a composite index on the ordered data set, the composite index comprising an array, wherein each string of the array comprises a concatenation of visualization data values corresponding to the first set of columns and non-visualization data values corresponding to the second set of columns based on an order of the ordered data set;
• generating a query by retrieving at least one string from the composite index and for each column in the second set of columns:
• determining whether a filtering operation is applied to the column,
• in response to determining that the filtering operation is applied to the column and that the filter operation is associated with a first filter value, including a filter for the column in the query, wherein the filter comprises the first filter value, and
• in response to determining that a filtering operation is not applied to the column, including a NOT filter for the column in the query, wherein the NOT filter comprises a second filter value different than the data values in the column;
• and
• processing the query for the data visualization.

A computer-implemented system, comprising:

• a computer memory;
• and
• a hardware processor interoperably coupled with the computer memory and configured to perform operations comprising:
• receiving a document, the document comprising visualization metadata for a data visualization of a data set and data set metadata comprising information of all columns of the data set, wherein the visualization metadata comprises information of all the columns of the data set present in a data visualization and indicates a mapping between the columns and vertical bars displayed relative to a horizontal axis and a vertical axis of the data visualization, and wherein the data set comprises a plurality of data columns, each of the plurality of data columns has a column name and a plurality of data values, and a first set of columns of the plurality of data columns is displayed by the data visualization;
• determining the first set of columns displayed by the data visualization based on the visualization metadata;
• determining a second set of columns of the plurality of data columns that are excluded from the data visualization, wherein the second set of columns comprises remaining columns of the plurality of data columns excluding the first set of columns;
• generating an ordered data set by having the first set of columns prior to the second set of columns;
• generating a composite index on the ordered data set, the composite index comprising an array, wherein each string of the array comprises a concatenation of visualization data values corresponding to the first set of columns and non-visualization data values corresponding to the second set of columns based on an order of the ordered data set;
• generating a query by retrieving at least one string from the composite index and for each column in the second set of columns:
• determining whether a filtering operation is applied to the column,
• in response to determining that the filtering operation is applied to the column and that the filter operation is associated with a first filter value, including a filter for the column in the query, wherein the filter comprises the first filter value, and
• in response to determining that a filtering operation is not applied to the column, including a NOT filter for the column in the query, wherein the NOT filter comprises a second filter value different than the data values in the column;
• and
• processing the query for the data visualization.