Parallel execution of a loop

A computer-readable storage device comprising:

• a memory device configured for storing computer-executable instructions configured to execute a loop over an integer index range of indices in a parallel manner, the computer-executable instructions comprising:
• first instructions that assign a plurality of index subsets of the integer index range to a corresponding plurality of threads;
• second instructions that define for each index subset a start point of the index subset, an end point of the index subset, and a boundary point of the index subset positioned between the start point and the end point of the index subset, a portion of the index subset between the start point and the boundary point represents a private range and the portion of the index subset between the boundary point and the end point represents a public range, each private range being executable by the thread to which it is assigned without synchronization with other threads of the plurality of threads and each public range being accessible by the plurality of threads;
• and
• loop code instructions that execute with each thread based on the index subset of the integer index range assigned to the thread.

A method of executing a loop over an integer index range of indices in a parallel manner, comprising:

• assigning a plurality of index subsets of the integer index range to a corresponding plurality of threads;
• defining for each index subset a start point of the index subset, an end point of the index subset, and a boundary point of the index subset positioned between the start point and the end point of the index subset, a portion of the index subset between the start point and the boundary point represents a private range and the portion of the index subset between the boundary point and the end point represents a public range, each thread being configured to steal indices from the public ranges of index subsets assigned to other threads after the indices in the index subset assigned to the thread have been processed;
• and
• executing loop code with each thread based on the index subset of the integer index range assigned to the thread.