Data replication in a clustered computing environment
AssigneeSplunk Inc.
InventorsVishal Patel, Mitchell Neuman Blank, Jr., Sundar Renegarajan Vasan, Stephen Phillip Sorkin
Life of this patent
Estimating the term…
Abstract
Embodiments are directed towards managing within a cluster environment having a plurality of indexers for data storage using redundancy the data being managed using a generation identifier, such that a primary indexer is designated for a given generation of data. When a master device for the cluster fails, data may continue to be stored using redundancy, and data searches performed may still be performed.
Claims31
A method, comprising:
- receiving, at a selected indexer within a plurality of indexers in a cluster, data from a forwarder indexer, wherein the selected indexer is designated as a primary indexer for the data, wherein the primary indexer has primary responsibility for responding to search queries pertaining to the data;
- receiving, at the selected indexer, data replication instructions from a master node of the cluster, wherein the data replication instructions comprise a list of other indexers in the cluster for storing a replicated copy of the data, wherein a number of the other indexers is determined in accordance with a replication factor configured for the cluster, and wherein the other indexers are designated as secondary indexers for the data, wherein the secondary indexers have secondary responsibility for responding to search queries pertaining to the data replicated between the primary indexer and the secondary indexers;
- and
- transmitting, from the selected indexer, the data to the other indexers for replication.
A non-transitory computer-readable medium storing computer-executable instructions which, when executed by a processor, cause the processor to perform operations comprising:
- receiving, at a selected indexer within a plurality of indexers in a cluster, data from a forwarder indexer, wherein the selected indexer is designated as a primary indexer for the data, wherein the primary indexer has primary responsibility for responding to search queries pertaining to the data;
- receiving, at the selected indexer, data replication instructions from a master node of the cluster, wherein the data replication instructions comprise a list of other indexers in the cluster for storing a replicated copy of the data, wherein a number of the other indexers is determined in accordance with a replication factor configured for the cluster, and wherein the other indexers are designated as secondary indexers for the data, wherein the secondary indexers have secondary responsibility for responding to search queries pertaining to the data replicated between the primary indexer and the secondary indexers;
- and
- transmitting, from the selected indexer, the data to the other indexers for replication.
A system comprising:
- at least one memory storing computer-executable instructions;
- and
- at least one processor, wherein the at least one processor is configured to access the at least one memory and to execute the computer-executable instructions to:
- receive, at a selected indexer within a plurality of indexers in a cluster, data from a forwarder indexer, wherein the selected indexer is designated as a primary indexer for the data, wherein the primary indexer has primary responsibility for responding to search queries pertaining to the data;
- receive, at the selected indexer, data replication instructions from a master node of the cluster, wherein the data replication instructions comprise a list of other indexers in the cluster for storing a replicated copy of the data, wherein a number of the other indexers is determined in accordance with a replication factor configured for the cluster, and wherein the other indexers are designated as secondary indexers for the data, wherein the secondary indexers have secondary responsibility for responding to search queries pertaining to the data replicated between the primary indexer and the secondary indexers;
- and
- transmit, from the selected indexer, the data to the other indexers for replication.
Dependencies are inferred from the claim text.