Processing pre-existing data sets at an on demand code execution environment

A computer-implemented method comprising:

• maintaining a data cache configured to store indications of which data items, from a set of data items within a data source, are awaiting processing at an on-demand code execution environment via execution of computer-executable code representing a task;
• iteratively retrieving subsets of data items, from the set of data items, from the data source;
• enqueuing within the data cache those data items, from the subsets of data items, that are not currently identified within the data cache;
• determining whether the data cache is empty;
• in response to determining that the data cache is not empty:
• iteratively submitting calls to the on-demand code execution environment to process each data item enqueued in the data cache by execution of the computer-executable code corresponding to the task;
• and
• dequeuing from the data cache those data items, of the one or more data items, successfully processed by execution of the computer-executable code responsive to a determination that the dequeued data items have been successfully processed by execution of the computer-executable code;
• recording results of the calls;
• based at least in part on determining that the data cache is empty, determining that no additional data items, from the set of data items, are awaiting processing by execution of the task;
• and
• in response to determining that no additional data items, from the set of data items, are awaiting processing by execution of the task, transmitting, to a user computing device associated with the set of data items, a notification indicating that processing of the set of data items has been completed.

Non-transitory computer readable media including computer-executable instructions, wherein the computer-executable instructions, when executed by a computing system, cause the computing system to:

• maintain a data cache configured to store indications of which data items, from a plurality of data items within a data source, are awaiting processing at an on-demand code execution environment via execution of computer-executable code representing a task;
• retrieve one or more data items, from the plurality of data items, from the data source;
• enqueue within the data cache those data items, from the one or more data items, that are not currently identified within the data cache;
• while the data cache is not empty, and in response to determining that the data cache is not empty:
• submit one or more calls to the on-demand code execution environment to process each data item enqueued in the data cache by execution of the computer-executable code corresponding to the task;
• responsive to determining that a call to process at least one data item from the data cache has completed, remove from the data cache the at least one data item;
• record results of calls submitted to on-demand code execution environment;
• based at least in part on determining that the data cache is empty, determine that no additional data items, from the plurality of data items, are awaiting processing by execution of the task;
• and
• in response to determining that no additional data items, from the plurality of data items, are awaiting processing by execution of the task, transmit, to a user computing device associate with the plurality of data items, a notification indicating that processing of the plurality of data items has been completed.