Distributed Multiple Tier Multi-Node Serverless Framework for Complex Analytics Task Execution

A method including:

• at network interface circuitry:
• receiving ingestion detail data from multiple data;
• and
• sending first and second prescriptive outputs to a storage host server;
• and
• at tiered analytic processing circuitry configured to execute multiple tiers of serverless tasks:
• establishing, at a data ingestion tier of the multiple tiers, a data ingestion serverless task configured to:
• accessing, via execution of the data ingestion serverless task, the ingestion detail data;
• generating, via execution of the data ingestion serverless task, an ingestion inter-tier communication link;
• via the ingestion inter-tier communication link:
• initiating, via execution of the data ingestion serverless task, a data integration serverless task;
• responsive to initiation from the data ingestion serverless task, establishing, at a data integration and consolidation tier of the multiple tiers, the data integration serverless task;
• sorting, via execution of the data integration serverless task, the ingestion detail data into an association grouping to generate grouped detail data;
• parsing, via execution of the data integration serverless task, the grouped detail data to identify patterns present within the grouped detail data to generate grouped pre-processed data;
• generating, via execution of the data integration serverless task, a data integration inter-tier communication link;
• via the data integration inter-tier communication link:
• initiating, via execution of the data integration serverless task, a partitioning serverless task;
• and
• responsive to initiation from the data integration serverless task, establishing, at a partitioning tier of the multiple tiers, the partitioning serverless task;
• identifying, via execution of the partitioning serverless task, a partitioning criterion and a concurrency criterion based on a serverless task execution limit and a size of the grouped pre-processed data;
• partitioning, via execution of the partitioning serverless task, the grouped pre-processed data in accord with the partitioning criterion to generate a first data chunk and a second data chunk;
• generating, via execution of the partitioning serverless task, a partitioning inter-tier communication link;
• via the partitioning inter-tier communication link:
• initiating, via execution of the partitioning serverless task, a first multi-node analytic serverless task;
• and
• responsive to initiation from the partitioning serverless task, establishing, at an analytic tier of the multiple tiers, the first multi-node analytic serverless task;
• analyzing, via execution of the first multi-node analytic serverless task, the first data chunk and at least a first portion the patterns present within the grouped detail data to generate the first prescriptive output;
• initiating a second multi-node analytic serverless task, the period based on the concurrency criterion;
• responsive to initiation from the first multi-node analytic serverless task, establishing, at the analytic tier, the second multi-node analytic serverless task;
• and
• analyzing, via execution of the second multi-node analytic serverless task, the second data chunk and at least a second portion the patterns present within the grouped detail data to generate the second prescriptive output.

A product including:

• machine-readable media other than a transitory signal;
• and
• instructions stored on the machine-readable media, the instructions configured to, when executed, cause a machine to:
• at network interface circuitry:
• receive ingestion detail data from multiple data;
• and
• send first and second prescriptive outputs to a storage host server;
• and
• at tiered analytic processing circuitry configured to execute multiple tiers of serverless tasks:
• establish, at a data ingestion tier of the multiple tiers, a data ingestion serverless task configured to:
• access, via execution of the data ingestion serverless task, the ingestion detail data;
• generate, via execution of the data ingestion serverless task, an ingestion inter-tier communication link;
• via the ingestion inter-tier communication link:
• initiate, via execution of the data ingestion serverless task, a data integration serverless task;
• responsive to initiation from the data ingestion serverless task, establish, at a data integration and consolidation tier of the multiple tiers, the data integration serverless task;
• sort, via execution of the data integration serverless task, the ingestion detail data into an association grouping to generate grouped detail data;
• parse, via execution of the data integration serverless task, the grouped detail data to identify patterns present within the grouped detail data to generate grouped pre-processed data;
• generate, via execution of the data integration serverless task, a data integration inter-tier communication link;
• via the data integration inter-tier communication link:
• initiate, via execution of the data integration serverless task, a partitioning serverless task;
• responsive to initiation from the data integration serverless task, establish, at a partitioning tier of the multiple tiers, the partitioning serverless task;
• identify, via execution of the partitioning serverless task, a partitioning criterion and a concurrency criterion based on a serverless task execution limit and a size of the grouped pre-processed data;
• partition, via execution of the partitioning serverless task, the grouped pre-processed data in accord with the partitioning criterion to generate a first data chunk and a second data chunk;
• generate, via execution of the partitioning serverless task, a partitioning inter-tier communication link;
• via the partitioning inter-tier communication link:
• initiate, via execution of the partitioning serverless task, a first multi-node analytic serverless task;
• responsive to initiation from the partitioning serverless task, establish, at an analytic tier of the multiple tiers, the first multi-node analytic serverless task;
• analyze, via execution of the first multi-node analytic serverless task, the first data chunk and at least a first portion the patterns present within the grouped detail data to generate the first prescriptive output;
• initiate a second multi-node analytic serverless task, the period based on the concurrency criterion;
• responsive to initiation from the first multi-node analytic serverless task, establish, at the analytic tier, the second multi-node analytic serverless task;
• and
• analyze, via execution of the second multi-node analytic serverless task, the second data chunk and at least a second portion the patterns present within the grouped detail data to generate the second prescriptive output.