Method and system for optimizing access to data nodes of a data cluster using a data access gateway and metadata mapping based bidding

A system for accessing data nodes of a data cluster, comprising:

• a processor;
• a data access gateway (DAG), which when executed by the processor performs a method, the method comprising:
• obtaining, by the DAG, a request from a host;
• and
• in response to the request:
• obtaining bidding counters from the data nodes;
• obtaining metadata mappings from the data nodes;
• identifying, based on the bidding counters and metadata mappings, a data node of the data nodes associated with a highest bidding counter of the bidding counters and an appropriate metadata mapping of the metadata mappings;
• and
• sending the request to the data node.

A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for accessing data nodes of a data cluster, the method comprising:

• obtaining, by a data access gateway (DAG), a request from a host;
• and
• in response to the request:
• obtaining bidding counters from the data nodes;
• obtaining metadata mappings from the data nodes;
• identifying, based on the bidding counters and metadata mappings, a data node of the data nodes associated with a highest bidding counter of the bidding counters and an appropriate metadata mapping of the metadata mappings;
• and
• sending the request to the data node.