Machine learning proxy system

A method, comprising:

• receiving, by an electronic device on a first network, an application request from a machine learning (ML) application client device on the first network, wherein the application request comprises application data captured by the ML application client device from one or more data streams communicated with a connected device on the first network and an indicated inference operation to be performed on the application data;
• pre-processing the application data based on parameters associated with the indicated inference operation;
• sending, by the electronic device, a proxy request to an ML proxy server device on the first network, wherein the ML proxy server device is separate from the electronic device and the proxy request comprises the pre-processed application data and the indicated inference operation to be performed on the pre-processed application data;
• receiving a proxy response from the ML proxy server device, wherein the proxy response comprises a result of the inference operation performed on the application data by the ML proxy server device;
• and
• sending a report based on the proxy response to a controller on a second network outside the first network.

A system, comprising:

• a machine learning (ML) application client configured to be executed on a first device on a first network to:
• monitor one or more data streams communicated with a connected device on the first network for application data associated with the ML application client;
• and
• capture the application data associated with the ML application client;
• an ML proxy server configured to be executed on a second device on the first network to:
• initiate and perform an ML inference operation;
• and
• an ML proxy client configured to be executed on a third device on the first network, wherein the third device is separate from the second device, and wherein the ML proxy client is configured to:
• receive an application request from the ML application client, wherein the application request comprises application data captured by the ML application client from the one or more data streams communicated with the connected device;
• send a proxy request to the ML proxy server, wherein the proxy request comprises the application data and an indicated inference operation to be performed on the application data;
• receive a proxy response from the ML proxy server, wherein the proxy response comprises a result of the inference operation performed on the application data by the ML proxy server;
• and
• send a report based on the proxy response to a controller outside the first network.