Flexible and efficient communication in microservices-based stream analytics pipeline

A computer program product for microservices-based real-time streaming video analytics pipelines, the computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform a method comprising:

• receiving a plurality of frames from a plurality of cameras, each camera corresponding to a respective camera driver, and each camera including a camera sidecar;
• arranging a plurality of detectors in layers such that a first detector layer includes detectors with detector sidecars and detector business logic, and the second detector layer includes detectors with only sidecars;
• arranging a plurality of extractors in layers such that a first extractor layer includes extractors with extractor sidecars and extractor business logic, and the second extractor layer includes extractors with only sidecars;
• and
• enabling a mesh controller to communicate with the detector sidecars and extractor sidecars of the first layer only, the mesh controller, during registration, selectively assigning inputs to one or more of the detector sidecars of the first detector layer and one or more of the extractor sidecars of the first extractor layer to pull data items for processing.

A computer processing system for microservices-based real-time streaming video analytics pipelines, comprising:

• a memory device for storing program code;
• and
• a processor device, operatively coupled to the memory device, for running the program code to:
• receive a plurality of frames from a plurality of cameras, each camera corresponding to a respective camera driver, and each camera including a camera sidecar;
• arrange a plurality of detectors in layers such that a first detector layer includes detectors with detector sidecars and detector business logic, and the second detector layer includes detectors with only sidecars;
• arrange a plurality of extractors in layers such that a first extractor layer includes extractors with extractor sidecars and extractor business logic, and the second extractor layer includes extractors with only sidecars;
• and
• enable a mesh controller to communicate with the detector sidecars and extractor sidecars of the first layer only, the mesh controller, during registration, selectively assigning inputs to one or more of the detector sidecars of the first detector layer and one or more of the extractor sidecars of the first extractor layer to pull data items for processing.