Fine-Grained Scheduling of Work in Runtime Systems

A method, comprising:

• performing, by a computer that includes multiple processor cores, each processor core including one or more hardware contexts:
• receiving two or more applications configured for parallel execution on the computer;
• for each of the two or more applications, associating a respective worker thread for the application with each hardware context in the computer so that each application has a respective worker thread associated with each hardware context;
• allocating, based on resource requirements of the applications, at least two of the hardware contexts to respective worker threads associated with the hardware contexts so that each application has at least one hardware context initially allocated to a worker thread for the application to perform an initial batch of work items for the application;
• the worker threads for which respective hardware contexts are currently allocated beginning to perform work on the respective hardware contexts on behalf of their respective applications;
• determining, during execution of the two or more applications on the computer, that the resource requirements for at least one of the applications have changed;
• and
• in response to the changed resource requirements:
• re-allocating, based on the changed resource requirements, one or more of the hardware contexts to respective worker threads associated with the hardware contexts;
• and
• continuing execution of at least one of the two or more applications on the computer.

A system, comprising:

• a plurality of processor cores, each processor core including one or more hardware contexts;
• and
• a memory storing program instructions that when executed on the computer cause the computer to:
• for each of two or more applications configured for parallel execution on the computer, associate a respective worker thread for the application with each hardware context in the computer so that each application has a respective worker thread associated with each hardware context;
• allocate, based on resource requirements of the applications, at least two of the hardware contexts to respective worker threads associated with the hardware contexts so that each application has at least one hardware context initially allocated to a worker thread for the application to perform an initial batch of work items for the application;
• begin execution of the applications, wherein the worker threads for which respective hardware contexts are currently allocated begin to perform work on the respective hardware contexts on behalf of their respective applications;
• determine, during execution of the applications, that the resource requirements for the applications have changed;
• and
• in response to the changed resource requirements, re-allocate, based on the changed resource requirements, one or more of the hardware contexts to respective worker threads associated with the hardware contexts;
• and
• continue execution of at least one of the applications on the computer.

One or more non-transitory, computer-readable storage media storing program instructions that when executed on or across one or more processor cores of a computer cause the computer to perform:

• receiving two or more applications configured for parallel execution on the processor cores of the computer, wherein each processor core includes one or more hardware contexts;
• for each of the two or more applications, associating a respective worker thread for the application with each hardware context in the computer so that each application has a respective worker thread associated with each hardware context;
• allocating, based on resource requirements of the applications, at least two of the hardware contexts to respective worker threads associated with the hardware contexts so that each application has at least one hardware context initially allocated to a worker thread for the application to perform an initial batch of work items for the application;
• the worker threads for which respective hardware contexts are currently allocated beginning to perform work on the respective hardware contexts on behalf of their respective applications;
• determining, during execution of the two or more applications on the computer, that the resource requirements for at least one of the applications have changed;
• and
• in response to the changed resource requirements:
• re-allocating, based on the changed resource requirements, one or more of the hardware contexts to respective worker threads associated with the hardware contexts;
• and
• continuing execution of at least one of the two or more applications on the computer.