Systems, methods, and devices for dynamic resource monitoring and allocation in a cluster system

A non-virtual computer cluster system, the system comprising:

• a management computing device comprising one or more computer readable storage devices configured to store a plurality of computer executable instructions and one or more hardware computer processors in communication with the one or more computer readable storage devices and configured to execute the plurality of computer executable instructions in order to cause the management computing device to coordinate processing of a plurality of sub-jobs for an overall job;
• and
• a plurality of computer system nodes configured to perform processing of the plurality of sub-jobs for the overall job, each of the plurality of computer system nodes comprising one or more computer readable storage devices configured to store a plurality of computer executable instructions and one or more hardware computer processors in communication with the one or more computer readable storage devices and configured to execute the plurality of computer executable instructions in order to cause each of the plurality of computer system nodes to:
• monitor utilization of system resources of the computer system node for processing one or more of the plurality of sub-jobs, the system resources comprising at least one of CPU, electronic storage input/output, network, and memory of the computer system node;
• and
• periodically report the monitored system resource utilization to the management computing device,
• wherein the management computing device is a separate computing device from each of the plurality of computer system nodes, and
• wherein the management computing device is configured to coordinate processing of the plurality of sub-jobs by the plurality of computer system nodes based at least in part on the monitored system resource utilization of the plurality of computer system nodes.

A computer-implemented method for coordinating processing of a plurality of sub-jobs for an overall job by a plurality of computer system nodes in a non-virtual computer cluster system, the method comprising:

• monitoring, by each of the plurality of computer system nodes of the computer cluster system, utilization of system resources of each of the plurality of computer system nodes for processing one or more of the plurality of sub-jobs for the overall job, the system resources comprising at least one of CPU, electronic storage input/output, network, and memory of the particular computer system node;
• periodically reporting, by each of the plurality of computer system nodes of the computer cluster system, the monitored system resource utilization to the management computing device of the computer cluster system;
• receiving, by the management computing device, the monitored system resource utilization of each of the plurality of computer system nodes of the computer cluster system;
• and
• coordinating, by the management computing device, processing of the plurality of sub-jobs by the plurality of computer system nodes based at least in part on the monitored system resource utilization of the plurality of computer system nodes,
• wherein each of the plurality of computer system nodes and the management computing device comprises a computer processor and an electronic storage medium.