Video system, imaging device, and video processing device

A video system comprising an imaging device and a video processing device, wherein

• the imaging device comprises:
• an imaging unit configured to generate video data by imaging;
• a front side NN unit comprising multiple layers of neural networks from an input layer to a predetermined intermediate hidden layer (hereinafter referred to as “intermediate hidden layer”) are that configured to perform recognition processing of the video data;
• and
• an imaging side control unit configured to transmit an output of the intermediate hidden layer of the front side NN unit (hereinafter referred to as “intermediate feature quantity”), and
• the video processing device comprises:
• a video processing side control unit configured to acquire the intermediate feature quantity transmitted from the imaging side control unit and
• a rear side NN unit comprising the multiple layers of the neural networks from a layer subsequent the intermediate hidden layer to an output layer, the rear side NN unit configured to perform the remaining recognition processing regarding the intermediate feature quantity acquired by the video processing side control unit, and
• the video processing device or an exterior thereof comprises:
• an entire NN model configured to implement an entire node of the neural networks, and
• an NN learning unit configured to perform a learning processing with respect to the entire NN model and determine a configuration parameter of each node of the entire NN model,
• the imaging side control unit is configured to
• acquire the configuration parameter corresponding to each node of the front side NN unit from the NN learning unit and set the same to each node of the front side NN unit, and
• the video processing side control unit is configured to
• acquire the configuration parameter corresponding to each node of the rear side NN unit from the NN learning unit and set the same to each node of the rear side NN unit.

A video system comprising an imaging device and a video processing device, wherein

• the imaging device comprises:
• an imaging unit configured to generate video data by imaging;
• a front side NN unit comprising multiple layers of neural networks from an input layer to a predetermined intermediate hidden layer (hereinafter referred to as “intermediate hidden layer”) are that configured to perform recognition processing of the video data;
• and
• an imaging side control unit configured to transmit an output of the intermediate hidden layer of the front side NN unit (hereinafter referred to as “intermediate feature quantity”), and
• the video processing device comprises:
• a video processing side control unit configured to acquire the intermediate feature quantity transmitted from the imaging side control unit;
• and
• a rear side NN unit comprising the multiple layers of the neural networks from a layer subsequent the intermediate hidden layer to an output layer, the rear side NN unit configured to perform the remaining recognition processing regarding the intermediate feature quantity acquired by the video processing side control unit, and
• at least one of the imaging side control unit and the video processing side control unit comprises
• a node allocation unit configured to change allocation of a number of nodes of the front side NN unit and a number of nodes of the rear side NN unit, and
• wherein the front side NN unit and the rear side NN unit communicates a configuration parameter of a node being transferred according to the allocation of the number of nodes being changed by the node allocation unit.