# US 10,313,211 B1 · Distributed network service risk monitoring and scoring

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,313,211 B1
- Document ID: US10313211B1
- Status: Granted
- Kind: B1
- Application number: 15/246,228
- Filed: 2016-08-24
- Granted: 2019-06-04
- Earliest claimed: 2015-08-25
- Assignees: Avi Networks
- Applicants: Avi Networks
- Inventors: Gaurav Rastogi; Sandeep Yadav; Murali Basavaiah
- Web page: https://patentgrep.com/patent/US10313211B1

## CPC

- H04L 63/1433: {Vulnerability analysis}
- H04L 41/0631: using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
- H04L 41/0677: Localisation of faults
- H04L 41/142: using statistical or mathematical methods
- H04L 41/5009: Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
- H04L 41/5096: {wherein the managed service relates to distributed or central networked applications}
- H04L 43/045: for graphical visualisation of monitoring data
- H04L 43/065: related to network devices
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A method for evaluating health of a distributed network service environment (DNSE) includes determining an application performance measurement (APM) based at least in part on performance metrics (PM) associated with sources, where the sources are associated with the DNSE. The sources include service engine(s) and servers. At least some of the servers are configured to provide a distributed application, and the service engine(s) are configured to provide the servers with a network service and collect at least a part of the PM. The method includes determining a health risk of the DNSE based at least in part on risk parameters obtained by the service engine(s). The method includes combining the APM and the health risk of the DNSE to determine a health indicator. If the indicator indicates a change of the DNSE, a notification of the change is generated. The method includes outputting the notification of the change.

## Claims

### Claim 1

A method of evaluating health of a distributed network service environment (DNSE), comprising:
determining, by a processor, an application performance measurement based at least in part on a plurality of performance metrics associated with a plurality of sources, wherein:
the plurality of sources are associated with the DNSE;
the plurality of sources includes one or more service engines and a plurality of servers;
at least some of the plurality of servers are configured to provide a distributed application; and
the one or more service engines are configured to provide the plurality of servers with a network service, including by cooperating to carry out a network function of the distributed application and collect at least a part of the plurality of performance metrics;
determining, by the processor, a health risk of the DNSE based at least in part on a plurality of risk parameters obtained by the one or more service engines;
combining, by the processor, the application performance measurement and the health risk of the DNSE to determine a health indicator indicating overall health of a stack, wherein the stack includes at least a service engine and at least one server;
in the event that the health indicator indicates a health change of the DNSE, generating, by the processor, a notification of the health change of the DNSE; and
outputting, by the processor, the notification of the health change of the DNSE.

### Claim 2 (depends on 1)

The method of claim 1, wherein the health indicator is a single value.

### Claim 3 (depends on 1)

The method of claim 1, wherein the health indicator indicates one or more of: whether a service level agreement is met, whether resources are over-utilized, whether the DNSE is secure, and/or whether performance of the DNSE is predictable.

### Claim 4 (depends on 1)

The method of claim 1, further comprising providing a notification of one or more factors that contributed to the health change of the DNSE.

### Claim 5 (depends on 1)

The method of claim 1, wherein the outputting includes displaying the notification.

### Claim 6 (depends on 1)

The method of claim 1, wherein the outputting includes outputting the notification in an application programming interface.

### Claim 7 (depends on 1)

The method of claim 1, wherein the outputting includes outputting at least one reason for the health change.

### Claim 8 (depends on 1)

The method of claim 1, wherein the plurality of performance metrics includes two or more of:
a client performance metric measuring performance of a client accessing the distributed application;
a server metric measuring performance of a server providing the distributed application;
a network metric measuring performance of a network link providing the distributed application; and/or
a pool availability metric measuring performance of a pool of servers providing the distributed application.

### Claim 9 (depends on 1)

The method of claim 1, wherein the plurality of performance metrics includes at least one apdex.

### Claim 10 (depends on 1)

The method of claim 1, wherein the determination of the application performance measurement includes applying a function to the plurality of performance metrics.

### Claim 11 (depends on 10)

The method of claim 10, wherein the function includes at least one of: a minimum, a maximum, and an average.

### Claim 12 (depends on 1)

The method of claim 1, wherein a performance metric in the plurality of performance metrics is determined by:
collecting samples associated with the performance metric;
classifying the samples relative to a benchmark; and
evaluating the performance metric based on classifications of the samples.

### Claim 13 (depends on 1)

The method of claim 1, wherein at least some of the plurality of risk parameters are determined by the one or more service engines.

### Claim 14 (depends on 1)

The method of claim 1, wherein the plurality of risk parameters measures a virtual server associated with at least one of the one or more service engines and at least one of the plurality of servers, the risk parameters including a security parameter, a resource parameter, and a consistency parameter.

### Claim 15 (depends on 14)

The method of claim 14, wherein the resource parameter is based at least in part on resource utilization metrics.

### Claim 16 (depends on 14)

The method of claim 14, wherein the security parameter is based at least in part on a combination of SSL configuration settings and attack measurements.

### Claim 17 (depends on 14)

The method of claim 14, wherein the consistency parameter is based at least in part on a percentage of metrics that are anomalous as measured against a benchmark.

### Claim 18 (depends on 1)

The method of claim 1, wherein the network service provided by the one or more service engines is a distributed network service.

### Claim 19

A system for evaluating health of a distributed network service environment (DNSE), comprising:
a processor configured to:
determine an application performance measurement based at least in part on a plurality of performance metrics associated with a plurality of sources, wherein:
the plurality of sources are associated with the DNSE;
the plurality of sources includes one or more service engines and a plurality of servers;
at least some of the plurality of servers are configured to provide a distributed application; and
the one or more service engines are configured to provide the plurality of servers with a network service including by cooperating to carry out a network function of the distributed application and collect at least a part of the plurality of performance metrics;
determine a health risk of the DNSE based at least in part on a plurality of risk parameters obtained by the one or more service engines;
combine the application performance measurement and the health risk of the DNSE to determine a health indicating overall health of a stack, wherein the stack includes at least a service engine and at least one server;
in the event that the health indicator indicates a health change of the DNSE, generate a notification of the health change of the DNSE; and
output the notification of the health change of the DNSE; and
a memory coupled to the processor and configured to provide the processor with instructions.

### Claim 20

A computer program product for evaluating health of a distributed network service environment (DNSE), the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
determining an application performance measurement based at least in part on a plurality of performance metrics associated with a plurality of sources, wherein:
the plurality of sources are associated with the DNSE;
the plurality of sources includes one or more service engines and a plurality of servers;
at least some of the plurality of servers are configured to provide a distributed application; and
the one or more service engines are configured to provide the plurality of servers with a network service including by cooperating to carry out a network function of the distributed application and collect at least a part of the plurality of performance metrics;
determining a health risk of the DNSE based at least in part on a plurality of risk parameters obtained by the one or more service engines;
combining the application performance measurement and the health risk of the DNSE to determine a health indicator indicating overall health of a stack, wherein the stack includes at least a service engine and at least one server;
in the event that the health indicator indicates a health change of the DNSE, generating a notification of the health change of the DNSE; and
outputting the notification of the health change of the DNSE.
