Reducing synchronization of tasks in latency-tolerant task-parallel systems

One or more non-transitory computer-readable media carrying instructions which, when executed by one or more processors, cause:

• storing a plurality of tasks in a queue of tasks;
• identifying, by a single thread, a particular task that is at the head of the queue, wherein the particular task is one of the plurality of tasks;
• determining, by the single thread, whether the particular task requires an I/O operation;
• in response to determining that the particular task requires an I/O operation:
• generating and sending an I/O request;
• updating state information associated with the particular task to indicate that a response to the I/O request is pending;
• without placing the particular task in another queue, retaining the particular task in the queue;
• selecting a subsequent task in the queue of tasks to process.

A first computer system comprising:

• one or more processors;
• one or more computer-readable media storing instructions which, when executed by the one or more processors, cause:
• storing a plurality of tasks in a queue of tasks;
• identifying, by a single thread, a particular task that is at the head of the queue, wherein the particular task is one of the plurality of tasks;
• determining, by the single thread, whether the particular task requires a network I/O operation;
• in response to determining that the particular task requires a network I/O operation:
• generating an I/O request;
• sending the I/O request to a second computer system that is communicatively coupled to the first computer system;
• without placing the particular task in another queue, retaining the particular task in the queue;
• selecting, by the single thread, a subsequent task in the queue to process.