Self-optimizing video analytics pipelines

A non-transitory computer-readable storage medium comprising a computer-readable program for implementing a self-optimized video analytics pipeline, wherein the computer-readable program when executed on a computer causes the computer to perform the steps of;

• decoding video files into a sequence of frames;
• extracting features of objects from one or more frames of the sequence of frames of the video files;
• employing an adaptive resource allocation component based on reinforcement learning (RL) to dynamically balance resource usage of different microservices included in the video analytics pipeline;
• employing an adaptive microservice parameter tuning component to balance accuracy and performance of a microservice of the different microservices;
• applying a graph-based filter to minimize redundant computations across the one or more frames of the sequence of frames;
• and
• applying a deep-learning-based filter to remove unnecessary computations resulting from mismatches between the different microservices in the video analytics.

A system for implementing a self-optimized video analytics pipeline, the system comprising:

• a memory;
• and
• one or more processors in communication with the memory configured to:
• decode video files into a sequence of frames;
• extract features of objects from one or more frames of the sequence of frames of the video files;
• employ an adaptive resource allocation component based on reinforcement learning (RL) to dynamically balance resource usage of different microservices included in the video analytics pipeline;
• employ an adaptive microservice parameter tuning, component to balance accuracy and performance of a microservice of the different microservices;
• apply a graph-based filter to minimize redundant computations across the one or more frames of the sequence of frames;
• and
• apply a deep-learning-based filter to remove unnecessary computations resulting from mismatches between the different microservices in the video analytics pipeline.