Synchronous ingestion pipeline for data processing

A system, comprising:

• a processor;
• a non-transitory computer-readable medium;
• and
• stored instructions translatable by the processor for:
• receiving, from a client device, an ingestion request for ingestion of data;
• determining whether the ingestion request includes a query parameter;
• responsive to the query parameter not being found in the ingestion request, directing the ingestion request to an asynchronous ingestion pipeline in which the data is processed through a predetermined workflow;
• responsive to the query parameter being found in the ingestion request, extracting the query parameter and determining, using the query parameter, what ingestion pipeline components to call and in what order in a synchronous ingestion pipeline in which the data is processed through a dynamic workflow;
• and
• starting the synchronous ingestion pipeline consisting of the ingestion pipeline components determined using the query parameter from the ingestion request, wherein the data is ingested through the synchronous ingestion pipeline in which the ingestion pipeline components apply different functions to the data in the order determined based on the ingestion request.

A computer program product comprising a non-transitory computer-readable medium storing instructions translatable by a processor of a server system for:

• receiving, from a client device, an ingestion request for ingestion of data;
• determining whether the ingestion request includes a query parameter;
• responsive to the query parameter not being found in the ingestion request, directing the ingestion request to an asynchronous ingestion pipeline in which the data is processed through a predetermined workflow;
• responsive to the query parameter being found in the ingestion request, extracting the query parameter and determining, using the query parameter, what ingestion pipeline components to call and in what order in a synchronous ingestion pipeline in which the data is processed through a dynamic workflow;
• and
• starting the synchronous ingestion pipeline consisting of the ingestion pipeline components determined using the query parameter from the ingestion request, wherein the data is ingested through the synchronous ingestion pipeline in which the ingestion pipeline components apply different functions to the data in the order determined based on the ingestion request.