System for adaptive multithreaded recalculation operations

A method comprising:

• receiving an indication that a recalculation operation is to be completed for data stored in a data file;
• determining that a currently assigned number of available threads for execution of the recalculation operation is lower than a target number of threads for the recalculation operation, wherein the target number of threads for the recalculation operation is dynamically determined and periodically updated, by:
• determining a thread utilization metric for each thread in the currently assigned number of available threads during execution of a current dependency level of the recalculation operation;
• and
• periodically updating the target number of threads for the recalculation operation based on the determined thread utilization metric for each thread in the currently assigned number of available threads;
• requesting an additional thread for execution of the recalculation operation;
• beginning execution of the recalculation operation using the currently assigned number of available threads;
• receiving an indication that the additional thread is available for execution of the recalculation operation;
• updating the currently assigned number of available threads to include the additional thread;
• and
• subsequent to the update, continuing execution of the recalculation operation using the updated number of threads.

A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:

• receive an indication that a recalculation operation is to be completed for data stored in a data file;
• determine that a currently assigned number of available threads for execution of the recalculation operation is lower than a target number of threads for the recalculation operation, wherein the target number of threads for the recalculation operation is dynamically determined and periodically updated, by:
• determining a thread utilization metric for each thread in the currently assigned number of available threads during execution of a current dependency level of the recalculation operation;
• and
• periodically updating the target number of threads for the recalculation operation based on the determined thread utilization metric for each thread in the currently assigned number of available threads;
• request an additional thread for execution of the recalculation operation;
• begin execution of the recalculation operation using the currently assigned number of available threads;
• receive an indication that the additional thread is available for execution of the recalculation operation;
• update the currently assigned number of threads to include the additional thread;
• and
• subsequent to the update, continue execution of the recalculation operation using the updated number of threads.