Machine learning driven data collection of high-frequency network telemetry for failure prediction

An apparatus, comprising:

• one or more network interfaces to communicate with one or more networks;
• a processor coupled to the network interfaces and configured to execute one or more processes;
• and
• a memory configured to store a process executable by the processor, the process when executed configured to:
• receive telemetry data samples from a plurality of networking devices in the one or more networks;
• train a failure prediction model to predict failures in the one or more networks, using a training dataset comprising the received telemetry data samples;
• assess performance of the failure prediction model;
• train, based on the assessed performance of the failure prediction model, a machine learning-based classification model to determine whether a networking device should send a particular telemetry data sample to the apparatus;
• and
• send the machine learning-based classifier to one or more of the plurality of networking devices, to control which telemetry data samples the one or more networking devices send to the apparatus.

A tangible, non-transitory, computer-readable medium storing program instructions that cause a supervisory service to execute a process comprising:

• receiving, at a supervisory service for one or more networks, telemetry data samples from a plurality of networking devices in the one or more networks;
• training, by the service, a failure prediction model to predict failures in the one or more networks, using a training dataset comprising the received telemetry data samples;
• assessing, by the service, performance of the failure prediction model;
• training, by the service and based on the assessed performance of the failure prediction model, a machine learning-based classification model to determine whether a networking device should send a particular telemetry data sample to the service;
• and
• sending, by the service, the machine learning-based classifier to one or more of the plurality of networking devices, to control which telemetry data samples the one or more networking devices send to the supervisory service.