System and method for applying a deep learning neural network to data obtained from one or more sensors

A system for applying a deep learning neural network to data obtained from one or more sensors on a client computing system, the one or more sensors sensing components of an industrial scene, the system comprising:

• a network accessible server system linked to the client computing system, the server system configured to provision and send an application to be executable on the client computing system, the application allocating computing tasks to the server system, the server system provisioning the application based on a schema definition comprising metadata received from the client computing system such that the application is customized for the client computing system and causes interaction with the sensors particular to the client computing system;
• and
• one or more peripheral devices, at least one of the peripheral devices comprising one or more of the sensors, each peripheral device associated with the scene, each peripheral device connected to the client computing system, the client computing system transmitting the sensor data to the server system, the server system building a one or more trained classification models to extract one or more features using the sensor data sensed by the sensors connected to the client computing system, the one or more classification models applying a neural network based scene parsing and scene matching to a portion of the sensor data transmitted from the client computing system to parse and match the one or more extracted features as feature vectors, training of the one or more classification models considering only sensor data from the one or more sensors connected to the client computing system, the client computing system parsing and matching one or more features from other portions of the sensor data transmitted from the client computing system based on feature vectors computed using the one or more trained classification models received from the server system, the matching using previously known components, the client computing system controlling positioning, motion, or obtainment of sensor information of at least one of the peripheral devices based on the output of the matching from the one or more trained classification models.