Caching netgroups

A non-transitory computer readable medium for determining a progress of an execution of a task, the non-transitory computer readable medium stores instructions for:

• updating, by a compute element of a first plurality of compute elements, a compute entity entry of a shared task status data structure, with a current progress made by the compute element in relation to the execution of the task;
• wherein the compute entity entry belongs to the shared task status data structure and is allocated to the compute element;
• determining, by the compute element, whether to update a group entry of the shared task status data structure;
• wherein the group entry stores information about a progress of a group of compute elements that includes the compute element and some other compute elements of the first plurality of compute elements;
• updating, in the group entry, a value representing an aggregate progress of the group, when determining to update the group entry;
• accessing only a portion of the shared task status data structure that (a) is associated with the task, wherein the task is executed by the first plurality of compute elements, and (b) comprises multiple hierarchical levels;
• wherein an entry of a certain of the multiple hierarchical levels represents an aggregate progress associated with multiple entries of another hierarchical level of the multiple hierarchical levels;
• the certain hierarchical level is higher than the another hierarchical level;
• and
• determining the progress of the execution of the task based on a content of the portion.