Back to results
US 12,754,817 B2Granted
Machine learning for rule recommendation
AssigneeHewlett Packard Enterprise Development LP
InventorsRaja Kommula, Ganesh Byagoti Matad Sunkada, Thayumanavan Sridhar, Lawrence Croiden Lobo, Raj Yavatkar
Life of this patent
Estimating the term…
Abstract
A performance monitoring system includes a metric collector configured to receive, via metric exporters, telemetry data comprising metrics related to a network of computing devices. A metric time series database stores related metrics. An alert rule evaluator service is configured to evaluate rules using stored metrics. The performance monitoring system may include a machine learning module and is configured to automatically determine recommended alert rules.
Claims17
A method for recommending alert rules for a performance monitoring system, the method comprising:
- receiving, by a performance monitoring system, user-created alert rules;
- collecting, by the performance monitoring system, telemetry data including a plurality of metrics related to the user-created rules;
- reading, by the performance monitoring system, a first alert rule of the user-created alert rules, wherein the first alert rule is associated with a first metric of the plurality of metrics;
- determining, by the performance monitoring system, at least one related metric that is related to the first metric;
- creating, by the performance monitoring system, a set of provisional relevant rules using the at least one related metric;
- evaluating, by the performance monitoring system using the telemetry data, each provisional relevant rule in the set of provisional relevant rules to determine a corresponding provisional rule evaluation attribute that includes a provisional rule hit rate and a provisional rule miss rate;
- determining, by the performance monitoring system, for each provisional relevant rule in the set of provisional relevant rules, a corresponding relevant rule weight based on the corresponding provisional rule evaluation attribute, including evaluating the first alert rule using the telemetry data to determine a first alert rule hit rate and a first alert rule miss rate and using the first alert rule hit rate and the first alert rule miss rate to determine additional corresponding provisional rule evaluation attributes that are used in determining a corresponding provisional rule weight;
- determining, by the performance monitoring system, whether each provisional relevant rule is a recommended relevant rule based on the corresponding relevant rule weight;
- implementing, by the performance monitoring system, a provisional relevant rule determined to be the recommended relevant rule;
- and
- collecting, by the performance monitoring system, further telemetry data including a second plurality of metrics related to the provisional relevant rule determined to be the recommended relevant rule.
8 more elements
A performance monitoring system comprising processing circuitry coupled to a memory device, the memory and processing circuitry configured to:
- receive user-created alert rules;
- collect telemetry data including a plurality of metrics related to the user-created rules;
- read a first alert rule of the user-created alert rules, wherein the first alert rule is associated with a first metric of the plurality of metrics;
- determine at least one related metric that is related to the first metric;
- create a set of provisional relevant rules using the at least one related metric;
- evaluate each provisional relevant rule in the set of provisional relevant rules using the telemetry data to determine a corresponding provisional rule evaluation attribute that includes a provisional rule hit rate and a provisional rule miss rate;
- determine, for each provisional relevant rule in the set of provisional relevant rules, a corresponding relevant rule weight based on the corresponding provisional rule evaluation attribute, including evaluating the first alert rule using the telemetry data to determine a first alert rule hit rate and a first alert rule miss rate and using the first alert rule hit rate and the first alert rule miss rate to determine additional corresponding provisional rule evaluation attributes that are used in determining a corresponding provisional rule weight;
- determine whether each provisional relevant rule is a recommended relevant rule or an irrelevant rule based on the corresponding relevant rule weight;
- implement a provisional relevant rule determined to be the recommended relevant rule;
- and
- collect further telemetry data including a second plurality of metrics related to the provisional relevant rule determined to be the recommended relevant rule.
8 more elements
A non-transitory computer-readable storage medium storing instructions thereon that when executed cause one or more processors, via execution of a performance monitoring system, to:
- receive user-created alert rules;
- collect telemetry data including a plurality of metrics related to the user-created rules;
- read a first alert rule of the user-created alert rules, wherein the first alert rule is associated with a first metric of the plurality of metrics;
- determine at least one related metric that is related to the first metric;
- create a set of provisional relevant rules using the at least one related metric;
- evaluate each provisional relevant rule in the set of provisional relevant rules using the telemetry data to determine a corresponding provisional rule evaluation attribute that includes a provisional rule hit rate and a provisional rule miss rate;
- determine, for each provisional relevant rule in the set of provisional relevant rules, a corresponding relevant rule weight based on the corresponding provisional rule evaluation attribute, including evaluating the first alert rule using the telemetry data to determine a first alert rule hit rate and a first alert rule miss rate and using the first alert rule hit rate and the first alert rule miss rate to determine additional corresponding provisional rule evaluation attributes that are used in determining a corresponding provisional rule weight;
- determine whether each provisional relevant rule is a recommended relevant rule or an irrelevant rule based on the corresponding relevant rule weight;
- implement a provisional relevant rule determined to be the recommended relevant rule;
- and
- collect further telemetry data including a second plurality of metrics related to the provisional relevant rule determined to be the recommended relevant rule.
8 more elements
Dependencies are inferred from the claim text.