Resource monitoring in a distributed storage system

A method for managing a distributed electronic storage system (DESS), the method comprising:

• generating, in a first hardware processor component of a first computing device, an indication of a load on a first set of one or more resources that reside on said first computing device, wherein said first set of one or more resources comprises a first network adapter operable to store DESS traffic in a virtual container;
• receiving, from a second hardware processor component of a second computing device via said one or more network links, an indication of a load on a second set of one or more resources that reside on said second computing device, wherein said second set of one or more resources comprises a second network adapter operable to store DESS traffic;
• transmitting, from said first hardware processor component of said first computing device to said second hardware processor component of said second computing device, said indication of said load on said first set of one or more resources that reside on said first computing device, wherein said second hardware processor component of said second computing device is operable to determining said condition of the DESS according said load on said first set of one or more resources that reside on said first computing device;
• determining, in said first hardware processor component of said first computing device, a condition of said DESS based on performance over said one or more network links, said indication of said load on said first set of one or more resources and said indication of said load on said second set of one or more resources, wherein said first computing device is operable to determine said condition as an underloaded condition and said first computing device is operable to determine said condition as an overperformance condition, and wherein said condition is adaptable over time according to a log file generated by a monitor on said local computing device;
• reducing a network congestion by changing a priority of DESS traffic according to said condition of said DESS;
• and
• adjusting, according to said condition of said DESS, one or more of:
• a read batch timing setting,
• a read batch size setting,
• a write batch timing setting, and
• a write batch size setting.

A system comprising:

• a local computing device communicatively coupled to a plurality of remote computing devices via one or more network links, wherein an electronic storage system is distributed among the local computing device and the plurality of remote computing devices;
• wherein the distributed electronic storage system (DESS) is operable to reduce a network congestion and communicate DESS traffic according to a priority, said DESS comprising:
• a first computing device comprising first management circuitry and a first network adapter comprising a first buffer operable to store said DESS traffic, wherein said first buffer is associated with a first depth;
• and
• a virtual container in a second computing device comprising a second network adapter, wherein said virtual container is operable to store said DESS traffic, and wherein said virtual container is associated with a second depth, said second computing device being communicatively coupled to said first computing device via one or more network links;
• wherein said first management circuitry is operable to change said priority of said DESS traffic according to said first depth, said second depth, and a first condition of said DESS, wherein said first management circuitry is operable to determine said first condition as an underloaded condition and said first management circuitry is operable to determine said first condition as an overperformance condition, and wherein said first condition is adaptable over time according to a first log file generated by a first monitor on said first computing device, and wherein second management circuitry on said second computing device is operable to change said priority of said DESS traffic according to a second condition of said DESS that is adaptable over time according to a second log file generated by a second monitor on said second computing device, and wherein said first management circuitry is operable to adjust, according to said first condition of said DESS, one or more of:
• a read batch timing setting, a read batch size setting, a write batch timing setting, and a write batch size setting.