Workload balancing in a distributed storage system

A computer program product comprising:

• one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising:
• program instructions to determine an expected available bandwidth for a plurality of storage devices of a distributed storage system based, at least in part, on historical I/O data that corresponds to one or more frontend applications;
• program instructions to generate a data retrieval plan for the plurality of storage devices based on (i) a historical I/O access pattern of the one or more frontend applications and (ii) the expected available bandwidth for the plurality of storage devices, wherein the data retrieval plan includes a scheduled start time and duration;
• program instructions to access data for a backend computational job from the plurality of storage devices according to the data retrieval plan;
• and
• program instructions to respond to a determination that I/O instructions per second (IOPS) of the one or more frontend applications exceeds a threshold by modifying the I/O throughput for the backend computational job based, at least in part, on the expected available bandwidth for the plurality of storage devices.

A computer system comprising:

• one or more computer processors;
• one or more computer readable storage media;
• and
• program instructions stored on the computer readable storage media for execution by the one or more computer processors, the program instructions, when executed by the one or more computer processors, causing the one or more computer processors to:
• determine an expected available bandwidth for a plurality of storage devices of a distributed storage system based, at least in part, on historical I/O data that corresponds to one or more frontend applications;
• generate a data retrieval plan for the plurality of storage devices based on (i) a historical I/O access pattern of the one or more frontend applications and (ii) the expected available bandwidth for the plurality of storage devices, wherein the data retrieval plan includes a scheduled start time and duration;
• access data for a backend computational job from the plurality of storage devices according to the data retrieval plan;
• and
• respond to a determination that I/O instructions per second (IOPS) of the one or more frontend applications exceeds a threshold by modifying the I/O throughput for the backend computational job based, at least in part, on the expected available bandwidth for the plurality of storage devices.