Optimization and update system for deep learning models

A non-transitory computer-readable medium storing computer instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:

• storing a deep learning model;
• executing the deep learning model to perform inferencing operations and to provide inferenced data to a software application;
• receiving an updated version of the deep learning model;
• and
• executing the updated version of the deep learning model to provide additional inferenced data to the software application.

A system, comprising:

• a memory storing instructions;
• and
• one or more processors that execute the instructions to perform a method comprising:
• receiving a deep learning model from a server;
• storing the deep learning model;
• executing the deep learning model to perform inferencing operations and to provide inferenced data to a software application;
• sending a request to the server to determine whether an updated version of the deep learning model is available;
• receiving the updated version of the deep learning model when an updated version of the deep learning model is available that meets or exceeds one or more improvement thresholds;
• and
• executing the updated version of the deep learning model to provide additional inferenced data to the software application.