Method and system for optimizing access to data nodes of a data cluster using a data access gateway

A system for accessing data nodes of a data cluster, comprising:

• A physical processor configured to initiate performance of a data access gateway (DAG) on a first data node of data nodes upon obtaining system metadata, wherein:
• the system metadata comprises prior performance information specifying at least one latency and at least one throughput associated with previous DAG operations performed by at least one of the data nodes;
• and
• the previous DAG operations performed by the at least one of the data nodes comprise:
• obtaining a previous request of requests types from a host;
• in response to obtaining the previous request, obtaining previous discovery metadata from each of the data nodes;
• updating, upon obtaining the previous discovery metadata, a previous discovery metadata repository on the at least one of the data nodes;
• and
• identifying, according to the previous discovery metadata, other data nodes of the data nodes to send the previous request;
• a data access gateway (DAG), which when executed by the processor performs a method, the method comprising:
• obtaining, by the DAG, a request of the request types from the host, wherein the DAG is not executing on the host, wherein the request types comprise:
• a read request, a write request, an update request, an information request, and a delete request;
• in response to obtaining the request:
• obtaining discovery metadata from each data node of the data nodes in the data cluster;
• wherein the discovery metadata specifies the data nodes of the data nodes that are available to serve the request;
• updating, using the obtained discovery metadata, a discovery metadata repository;
• identifying a second data node, of the data nodes, to serve the request according to the updated discovery metadata;
• and
• sending the request to the second data node of the data nodes.

A non-transitory computer readable medium comprising computer readable computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for accessing data nodes of a data cluster, the method comprising:

• initiating, by a data processor, performance of a data access gateway (DAG) on a first data node of data nodes upon obtaining system metadata, wherein:
• the system metadata comprises prior performance information specifying at least one latency and at least one throughput associated with previous DAG operations performed by at least one of the data nodes;
• and
• the previous DAG operations performed by the at least one of the data nodes comprise:
• obtaining a previous request of requests types from a host;
• in response to obtaining the previous request, obtaining previous discovery metadata from each of the data nodes;
• updating, upon obtaining the previous discovery metadata, a previous discovery metadata repository on the at least one of the data nodes;
• and
• identifying, according to the previous discovery metadata, other data nodes of the data nodes to send the previous request;
• in response to initiating the performance of the DAG on the first data node:
• obtaining, by the DAG, a request of the request types from the host, wherein the DAG is not executing on the host, wherein the request types comprise:
• a read request, a write request, an update request, an information request, and a delete request;
• in response to obtaining the request:
• obtaining discovery metadata from each data node of the data nodes in the data cluster;
• wherein the discovery metadata specifies the data nodes of the data nodes that are available to serve the request;
• updating, using the obtained discovery metadata, a discovery metadata repository;
• identifying a second data node, of the data nodes, to serve the request according to the updated discovery metadata;
• and
• sending the request to the second data node of the data nodes.