Method and system for dynamic handling in real time of data streams with variable and unpredictable behavior

A computer-implemented method for supervising data stream storage, the method comprising:

• communicating with at least one probe that captures network data and outputs the captured network data as a plurality of data streams;
• receiving from the at least one probe registration data associated with respective data streams, the registration data including identification of the associated probes that output the respective data streams;
• selecting at least one data repository unit of the plurality of data repository units to store the first data stream in real time based on a storage capacity of the plurality of data repository units to receive and store data;
• determining that storage capacity is not sufficient for the data stream in response to a change in the storage capacity of the plurality of data repository units to receive and store data;
• determining a corrective action in response to the determination that the storage capacity is not sufficient;
• and
• notifying the probe identified in association with the first data stream about the corrective action.

A method for supervising data stream storage, the method comprising:

• capturing network data;
• outputting the network data captured as a plurality of data streams to a network storage system having a plurality of data repository units, the output network data having associated registration data that identifies the respective data streams;
• and
• receiving in real time notification of a corrective action in response to a determination that storage capacity associated with a selected at least one data repository unit of the plurality of data repository units is no longer sufficient to store a first data stream of the plurality of data streams, the determination being based on a change in real time storage capacity of the plurality of data repository units to receive and store data,
• wherein the notification identifies the data stream affected by the corrective action.