Parallel i/o write processing for use in clustered file systems having cache storage

A method for providing parallel writing in a clustered file system having cache storage, the method comprising:

• using an owner gateway (GW) node to write data for a first fileset;
• determining whether to utilize one or more other GW nodes to handle at least a portion of write traffic for the first fileset;
• selecting a set of eligible GW nodes based on at least one of:
• a current internal workload, a network workload, and recent performance history data in regard to workload distribution across the one or more other GW nodes;
• assigning and defining a size for one or more write task items for each GW node in the set of eligible GW nodes based on a current dynamic profile of each individual GW node in the set of eligible GW nodes;
• providing and/or ensuring availability to in-memory and/or input/output (I/O) resources at each GW node in the set of eligible GW nodes to handle one or more assigned write task items;
• and
• distributing workload to the set of eligible GW nodes according to the size for each of the one or more assigned write task items for each individual GW node in the set of eligible GW nodes.

A system, comprising a processor and logic integrated with and/or executable by the processor, the logic being configured to:

• use an owner gateway (GW) node to write data for a first fileset;
• determine whether to utilize one or more other GW nodes to handle at least a portion of write traffic for the first fileset via one of:
• a background process periodically, and a foreground process before initiating a large input/output (I/O) request according to a predetermined I/O size threshold;
• select a set of eligible GW nodes based on at least one of:
• a current internal workload, a network workload, and recent performance history data in regard to workload distribution across the one or more other GW nodes;
• assign and defining a size for one or more write task items for each GW node in the set of eligible GW nodes based on a current dynamic profile of each individual GW node in the set of eligible GW nodes;
• provide and/or ensure availability to in-memory and/or I/O resources at each GW node in the set of eligible GW nodes to handle one or more assigned write task items;
• and
• distribute workload to the set of eligible GW nodes according to the size for each of the one or more assigned write task items for each individual GW node in the set of eligible GW nodes.