US 10,540,202 B1 · Transient sharing of available SAN compute capability

Abstract

Embodiments are described for a executing a processing job using one or more nodes of a storage area network using computing resources on the SAN that are predicted to be idle. A predictive model is generated by monitoring idle states of resources of nodes of the SAN and using machine learning to build the predictive model. A scheduler executes jobs on one or more nodes of the SAN with sufficient predicted idle resources to process the job, in accordance with resource requirements and job attributes in a manifest of the job. If a job cannot be completed during a window of time that the necessary resources are predicted to be idle, or if one or more resources become unavailable, the job can be paused and resumed, migrated to another node, or restarted at a later time when the required resources to complete the job are predicted to be idle.

Claims21

Dependent claims

A computer-implemented comprising:

receiving, by a scheduler, a processing job and a manifest for the processing job, the manifest including an estimate of one or more resources required to perform the processing job;
determining, by a scheduler on a first node in a multi-node network, at least one second node in the multi-node network, on which to execute the processing job using a plurality of computing resources predicted to be idle to execute the processing job on the at least one second node, wherein the determining is based at least in part upon whether a predictive model of idle times of computing resources in the multi-node network predicts that there are idle computing resources on the at least one second node having a magnitude that meets or exceeds an estimated requirements to perform the processing job;
and
in response to determining that an actual state of the computing resources predicted to be idle on the at least one second node meets or exceeds a predicted state of the computing resources on the at least one second node, executing the processing job on the at least one second node.

1 more element

A non-transitory computer-readable medium programmed with executable instructions that, when executed by a processing system having at least one hardware processor, perform operations comprising:

receiving a processing job and a manifest for the processing job, the manifest including an estimate of one or more resources required to perform the processing job;
determining, by a scheduler on a first node in a multi-node network, at least one second node the a multi-node network, on which to execute the processing job using a plurality of computing resources predicted to be idle to execute the processing job on the at least one second node, wherein the determining is based at least in part upon whether a predictive model of idle times of computing resources in the multi-node network predicts that there are idle computing resources on the at least one second node having a magnitude that meets or exceeds estimated requirements to perform the processing job;
and
in response to determining that an actual state of the computing resources predicted to be idle on the at least one second node meets or exceeds a predicted state of the computing resources on the at least one second node, executing the processing job on the at least one second node.

1 more element

A system comprising:

a processing system having at least one hardware processor, the processing system coupled to a memory programmed with executable instructions that, when executed by the processing system, perform operations comprising:
receiving a processing job and a manifest for the processing job, the manifest including an estimate of one or more resources required to perform the processing job;
determining, by a scheduler on a first node in a multi-node network, at least one second node in the multi-node network, on which to execute the processing job using a plurality of computing resources predicted to be idle to execute the processing job on the at least one second node, wherein the determining is based at least in part upon whether a predictive model of idle times of computing resources in the multi-node network predicts that there are idle computing resources on at least one second node having a magnitude that meets or exceeds estimated requirements to perform the processing job;
and
in response to determining that an actual state of the computing resources predicted to be idle on the at least one second node meets or exceeds a predicted state of the computing resources on the at least one second node, executing the processing job on the at least one second node.

2 more elements

Dependencies are inferred from the claim text.

Transient sharing of available SAN compute capability

Life of this patent

Transient sharing of available SAN compute capability

Life of this patent

Abstract

Claims21