Distributed Concurrent Batch Processing

A system comprising:

• at least one processor;
• and
• a memory in which are stored program instructions that, upon execution by the at least one processor, cause the at least on processor to perform operations comprising:
• receiving a command to perform a plurality of independent computational tasks within a time period;
• based on the plurality of independent computational tasks, the time period, and an indication of available computational threads, identifying a subset of the available computational threads;
• allocating the plurality of independent computational tasks to the subset of the available computational threads, wherein each computational thread of the subset of the available computational threads is allocated a respective number of the plurality of independent computational tasks;
• and
• performing the plurality of independent computational tasks via the subset of the available computational threads in accordance with the allocation.

An article of manufacture including a non-transitory computer-readable medium, having stored thereon program instructions that, upon execution by a computing system, cause the computing system to perform operations comprising:

• receiving a command to perform a plurality of independent computational tasks within a time period;
• based on the plurality of independent computational tasks, the time period, and an indication of available computational threads, identifying a subset of the available computational threads;
• allocating the plurality of independent computational tasks to the subset of the available computational threads, wherein each computational thread of the subset of the available computational threads is allocated a respective number of the plurality of independent computational tasks;
• and
• performing the plurality of independent computational tasks via the subset of the available computational threads in accordance with the allocation.