Cost-minimizing task scheduler

A computer-implemented method, comprising:

• receiving a definition of a task, wherein the definition comprises a need-by time, wherein the need-by time comprises a user-specified deadline for completion of execution of the task;
• determining an estimated duration to complete the execution of the task for each of a plurality of computing resources;
• selecting one or more of the computing resources based on an estimated cost of completing the execution of the task for each of the plurality of computing resources;
• and
• initiating the execution of the task at a scheduled time using the selected one or more computing resources, wherein the scheduled time is earlier than the need-by time by at least the estimated duration.

A system, comprising:

• at least one processor;
• a memory coupled to the at least one processor, wherein the memory stores program instructions, wherein the program instructions are executable by the at least one processor to:
• receive a need-by time for a task, wherein the need-by time comprises a deadline for completion of execution of the task;
• determine an estimated duration to complete the execution of the task for each of a plurality of resource configurations, wherein each of the plurality of resource configurations has a respective usage cost;
• selecting one or more of the resource configurations to minimize a cost of the execution of the task within an execution window, wherein an endpoint of the execution window is based on the need-by time;
• and
• determine a scheduled time for the execution of the task on one or more compute instances having the selected one or more resource configurations, wherein the scheduled time is earlier than the need-by time by at least the estimated duration.

A computer-readable storage medium storing program instructions computer-executable to perform:

• receiving a definition of a task, wherein the definition comprises a deadline for completion of execution of the task;
• selecting one or more resource configurations for the execution of the task, wherein the one or more resource configurations are selected to minimize a cost of the execution of the task;
• and
• scheduling the task for execution using the selected one or more resource configurations at a scheduled time, wherein the scheduled time is earlier than the deadline by at least an estimated duration to complete the execution of the task.