Dependency-based process of pre-existing data sets at an on demand code execution environment

A computer-implemented method to process a plurality of data items within a data source via an on-demand code execution environment, the computer-implemented method comprising:

• obtaining information identifying a task, on the on-demand code execution environment, to utilize in processing the plurality of data items and dependency data indicating dependencies in processing individual data items from the plurality of data items, wherein the task corresponds to user-supplied code executable on the on-demand code execution environment, and wherein the dependency data indicates that execution of the task with respect to a first data item of the plurality of data items requires completion of execution of the task with respect to a second data item of the plurality of data items;
• retrieving the plurality of data items from the data source and, as data items are retrieved, enqueuing the retrieved data items in a data cache;
• prior to submitting the first data item to the on-demand code execution environment for processing and prior to submitting the second data item to the on-demand code execution environment for processing, generating, at least partly by analyzing the data items within the data cache according to the dependency data, an ordering by which data items within the data cache will be submitted from the data cache to the on-demand code execution environment for processing via execution of the task, the ordering specifying at least that the second data item within the data cache is to be submitted to the on-demand code execution environment prior to the first data item within the data cache;
• prior to submitting a call to the on-demand code execution environment to process the first data item from the data cache, submitting a call to the on-demand code execution environment to process the second data item from the data cache, wherein the second data item is selected for submission prior to the first data item according to the generated ordering and based at least partly on the dependency data indicating that execution of the task with respect to the first data item requires completion of execution of the task with respect to the second data item;
• and
• in response to processing of the second data item, submitting a call to the on-demand code execution environment to process the first data item from the data cache.

Non-transitory computer-readable media including computer-executable instructions to process a plurality of data items within a data source via an on-demand code execution environment, wherein the computer-executable instructions, when executed by a computing system, cause the computing system to:

• obtain information identifying a task, on the on-demand code execution environment, to utilize in processing the plurality of data items and dependency data indicating dependencies in processing individual data items from the plurality of data items, wherein the task corresponds to user-supplied code executable on the on-demand code execution environment, and wherein the dependency data indicates that execution of the task with respect to a first data item of the plurality of data items requires completion of execution of the task with respect to a second data item of the plurality of data items;
• retrieve the plurality of data items from the data source and, as data items are retrieved, enqueue the retrieved data items in a data cache;
• prior to submitting the first data item to the on-demand code execution environment for processing and prior to submitting the second data item to the on-demand code execution environment for processing, generate, at least partly by analyzing the data items within the data cache according to the dependency data, an ordering by which data items within the data cache will be submitted to the on-demand code execution environment for processing via execution of the task, the ordering specifying at least that the second data item within the data cache is to be submitted to the on-demand code execution environment prior to the first data item within the data cache;
• and
• submit a series of calls to the on-demand code execution environment to process the data items from the data cache, wherein calls within the series of calls are ordered according to the generated ordering to include a call to process the second data item prior to a call to process the first data item.