On-Demand Compute Environment

A method of managing a first compute environment, the method comprising:

• receiving, at a first software module operating in the first compute environment, from a second software module associated with an external compute environment separate from the first compute environment, a specification of resources to be used as part of processing of a workload, the specification of resources comprising both (i) first data explicitly specifying resources, the specified resources which must be provided by the first compute environment when servicing the workload, and (ii) second data specifying one or more flexible resources, the flexible resources which can be dynamically modified by at least the first compute environment;
• creating a new software module within the first compute environment;
• provisioning at least one node in the first compute environment to perform at least part of the processing of the workload, wherein the new software module is configured to manage the provisioned at least one node and communicate with the second software module;
• and
• removing the new software module after one or more removal criteria have been met.

A computerized apparatus configured for communication with a first compute environment, the computerized apparatus associated with an external compute environment separate from the first compute environment, the computerized apparatus comprising:

• a processor;
• and
• a storage device in data communication with the processor, the storage device comprising a non-transitory computer-readable storage medium having stored therein instructions which, when executed by the processor, cause the computerized apparatus to:
• receive data relating to at least one rigid resource requirement for processing workload;
• cause creation of a specification of resources to process the workload, the specification of resources comprising both (i) the data relating to the at least one rigid resource requirement, and (ii) data relating to at least one flexible resource requirement;
• cause transmission of the specification of resources from a first software module of the computerized apparatus to a second software module operating on at least one node in the first compute environment, the specification of resources requiring creation of a third software module on at least one node in the first compute environment, the third software module associated uniquely with the specification of resources and configured to manage at least one compute resource in the first compute environment to process at least part of the workload.

A method of operating a first compute environment to cause utilization of compute resources within a second, separately managed compute environment, the method comprising:

• receiving at least one first data structure at the first compute environment, the at least one data structure comprising a request to process workload, the request comprising at least one explicit resource requirement;
• creating at least one second data structure, the at least one second data structure comprising both (i) data relating to the at least one explicit resource requirement, and (ii) data relating to at least one additional resource requirement, the at least one additional resource requirement based at least on at least one of a network attribute or operating system attribute of the first compute environment;
• causing transmission, from a first software module of the first compute environment to a second software module operating in the second compute environment, the at least one second data structure, the transmission configured to cause creation of a new software instance in the second compute environment, the new software instance configured to communicate with at least one compute node in the second compute environment to effect processing of at least a portion of the workload;
• and
• receiving at least one data communication at the first compute environment from the second compute environment, the at least one data communication indicating that the new software instance has been removed from the second compute environment pursuant to completion of processing of the at least portion of the workload.