Managing communications in a multi-client; multi-server environment

A method implemented by a client, comprising:

• generating a request that includes:
• a session identifier (ID) that identifies a session between the client and one of a plurality of servers of a server cluster;
• a correlation ID that is linked to the request;
• and
• a response list that contains correlation IDs linked to responses received from one or more servers of the server cluster for requests submitted by the client as part of the session;
• sending the request to the server;
• if a response to the request is not received within a predefined time period, re-sending the request to the same or another server of the server cluster;
• and
• if a response to the request is received within the predefined time period, updating the response list to include the correlation ID, and sending the updated response list to the same or another server of the server cluster.

A server that is part of a server cluster which includes a plurality of other servers, the server comprising:

• a memory circuit configured to store an individual server-specific session microcache for a session between the server and a client;
• and
• one or more processing circuits configured to:
• receive, from the client, a request that includes:
• a session identifier (ID) identifying the session between the client and the server;
• and
• a correlation ID that is linked to the request;
• determine whether the correlation ID is included in the session microcache;
• if the correlation ID is not included in the session microcache, process the request to determine a response, add the response to the session microcache, and send the response along with an indication of the correlation ID to the client;
• if the correlation ID and a response to the request are stored in the session microcache, re-send the response along with an indication of the correlation ID to the client;
• and
• transfer the session ID and session microcache to another of the plurality of servers in the server cluster to continue the session.

A client, comprising:

• one or more processing circuits configured to:
• generate a request that includes:
• a session identifier (ID) that identifies a session between the client and one of a plurality of servers of a server cluster;
• a correlation ID that is linked to the request;
• and
• a response list that contains correlation IDs linked to responses received from one or more servers of the server cluster for requests submitted by the client as part of the session;
• send the request to the server;
• if a response to the request is not received within a predefined time period, re-send the request to the same or another server of the server cluster;
• and
• if a response to the request is received within the predefined time period, update the response list to include the correlation ID, and send the updated response list to the same or another server of the server cluster;
• and
• a memory circuit configured to store the response list.