Faulty distributed system component identification
AssigneeMorgan Stanley Services Group Inc.
InventorsRichard Huddleston, Ahmed Jedda
Life of this patent
Estimating the term…
Abstract
A system for detecting a communications computer network node malfunction by analysis of network traffic output by the network node. Low latency packet capture nodes copy network traffic and transmit it to an analytics engine, which may use machine learning techniques, including long short-term memory (LSTM) neural networks, to determine a likelihood that the output of one data router in a network is suffering from a software malfunction, hardware malfunction, or network connectivity issue, and preserve overall data quality in the network by causing cessation of traffic by the malfunctioning node of the network.
Claims20
A system for detecting a data router malfunction, comprising:
- one or more low-latency packet monitors, each associated with a data router that is configured to receive an input data stream and forward to a central repository an output data stream that is a copy of a selected subset of the input data stream, each of which is placed between its associated data router and the central repository along a network path, and each of which receives and forwards the output data stream to an analytics computing device;
- and
- the analytics computing device, storing electronic instructions that, when executed by a processor of the analytics computing device, cause the analytics computing device to:
- receive, from the one or more low-latency packet monitors, the forwarded output data stream over a series of time windows;
- feed data from the output data stream over the series of time windows into a long short-term memory (LSTM) neural network;
- using the LSTM neural network, determine a probability that the output stream of a particular data router comprises a corruption of the input data stream due to software failure or hardware failure in the particular data router;
- and
- responsive to a determination that the probability exceeds a predetermined threshold, transmit an electronic message to the particular data router cause a cessation of the output data stream corrupting the input data stream.
A computer-implemented method for detecting a data router malfunction, comprising:
- receiving, by a computing device, from a low-latency packet monitor, and over a series of time windows, a copy of an output data stream from a data router that is configured to receive an input data stream and forward a selected subset of the input data stream as its output data stream;
- inputting, by the computing device and into a long short-term memory (LSTM) neural network, data received from the copy of the output data stream over the series of time windows;
- determining, by the computing device, after each time window, and using the LSTM neural network, a probability that received data from the present time window represents a corruption of the input data stream due to software failure or hardware failure in the data router;
- and
- responsive to determining that the probability exceeds a predetermined threshold, automatically transmitting an electronic message to the data router to modify output of the communications network node and prevent output of data by the data router that is not an accurate copy of data from the input data stream.
Dependencies are inferred from the claim text.