Systems and methods for distributed data analytics

A system for optimizing the execution of device-specific trained artificial neural network (ANN) models on edge devices, the system comprising:

• one or more processors;
• and
• a memory coupled with the one or more processors wherein the one or more processors executes computer-executable instructions stored in the memory, that when executed:
• identify a first trained ANN model and a second trained ANN model, wherein the first trained ANN model and the second trained ANN model each execute different inferences on input data and are trained using the same training dataset comprising the same input samples;
• merge the first trained ANN model, the second trained ANN model, and control flow execution instructions into a combined software package;
• and
• deploy, by a distribution module, the combined software package to a hardware component of an edge device through a network;
• and
• execute, by the hardware component of the edge device, the combined software package, wherein the edge device is configured to select either or both of the first and second trained ANN models for performing object detection based on the control flow instructions included in the wrapper function according to analytics criteria.

A non-transitory computer-readable storage medium storing computer-readable instructions that, when executed by a computer, cause the computer to perform a method, the method comprising:

• receiving, by a processor, a first trained ANN model and a second trained ANN model, wherein the first trained ANN model and the second trained ANN model each execute different inferences on input data and are trained using the same training dataset comprising the same input samples;
• merging the first trained ANN model, the second trained ANN model, and control flow execution instructions into a combined software package;
• communicating the combined software package to a hardware component of an edge device through a network;
• and
• deploying, by the hardware component of the edge device, the combined software package, wherein the edge device is configured to select either or both of the first and second trained ANN models for performing object detection based on the control flow instructions included in the wrapper function according to analytics criteria.