Space-efficient secondary indexing on distributed data stores

A system for space-efficient secondary indexing on distributed data stores in a networked computing environment, comprising:

• one or more computers with executable instructions that when executed cause the system to:
• sort replicas of corresponding master data at a file system level of a distributed file system (DFS) for creating secondary indexes of the replicas on different columns of a database table, wherein existing replication data is leveraged for the sorting;
• search for the replicas having a similar column for performing a query;
• wherein the secondary indexes of the replicas are sorted to allow for sequential access of the replicas stored on particular ones of a plurality of computing nodes identified according to the similar column, such that the searching of the different columns is performed on only a subset of the database table and terminates upon determining that entries of the secondary indexes no longer comply with the query;
• maintain a number of the secondary indexes of the sorted replicas equal to a replication factor, wherein the replication factor is equal to a number of the different columns;
• and
• maintain in memory one or more data tree structures, representing the secondary indexes of the sorted replicas on the different columns, equal to the replication factor.

A computer program product for, by a processor, space-efficient secondary indexing on distributed data stores in a networked computing environment, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:

• an executable portion that sorts replicas of corresponding master data at a file system level of a distributed file system (DFS) for creating secondary indexes of the replicas on different columns of a database table, wherein existing replication data is leveraged for the sorting;
• an executable portion that searches for the replicas having a similar column for performing a query;
• wherein the secondary indexes of the replicas are sorted to allow for sequential access of the replicas stored on particular ones of a plurality of computing nodes identified according to the similar column, such that the searching of the different columns is performed on only a subset of the database table and terminates upon determining that entries of the secondary indexes no longer comply with the query;
• an executable portion that maintains a number of the secondary indexes of the sorted replicas equal to a replication factor, wherein the replication factor is equal to a number of the different columns;
• and
• an executable portion that maintains in memory one or more data tree structures, representing the secondary indexes of the sorted replicas on the different columns, equal to the replication factor.