Distributed and parallel processing of data

A system for distributed and parallel processing of data within a data processing platform, the system comprising:

• a processor;
• a memory device that stores instructions that, when executed by the processor, causes the system to:
• receive, at the data processing platform, the data to be processed by the data processing platform, wherein the data processing platform comprises a plurality of processing components;
• ingest, at the plurality of processing components, the data, wherein the ingesting comprises the data being located at more than one of the plurality of processing components simultaneously;
• process, simultaneously at the more than one of the plurality of processing components, the data, wherein the processing comprises incorporating, by each of the more than one of the plurality of processing components, an identifier into an output of the processing of the data, the identifier corresponding to the data and indicating the output was generated from the data;
• and
• receive, at a downstream component of the data processing platform, the output from each of the plurality of processing components that processed the data, wherein the receiving comprises the downstream component identifying the outputs corresponding to the data based upon the identifier within the outputs and aggregating all the outputs corresponding to the data.

A product for distributed and parallel processing of data within a data processing platform, the product comprising:

• a computer-readable storage device that stores executable code that, when executed by a processor, causes the product to:
• receive, at the data processing platform, the data to be processed by the data processing platform, wherein the data processing platform comprises a plurality of processing components;
• ingest, at the plurality of processing components, the data, wherein the ingesting comprises the data being located at more than one of the plurality of processing components simultaneously;
• process, simultaneously at the more than one of the plurality of processing components, the data, wherein the processing comprises incorporating, by each of the more than one of the plurality of processing components, an identifier into an output of the processing of the data, the identifier corresponding to the data and indicating the output was generated from the data;
• and
• receive, at a downstream component of the data processing platform, the output from each of the plurality of processing components that processed the data, wherein the receiving comprises the downstream component identifying the outputs corresponding to the data based upon the identifier within the outputs and aggregating all the outputs corresponding to the data.