# US 2024/0205106 A1 · Key performance indicator threshold correlation aggregation apparatus and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0205106 A1
- Document ID: US20240205106A1
- Status: Published application
- Kind: A1
- Application number: 17/760,304
- Filed: 2022-05-18
- Published: 2024-06-20
- Earliest claimed: 2022-05-18
- Assignees: Rakuten Mobile, Inc.
- Applicants: Rakuten Mobile, Inc.
- Inventors: Vishvesh TRIVEDI; Anshul BHATT; Dhananjay CHAUBEY; Alok Singh PAWAR; Manish PATIDAR
- Web page: https://patentgrep.com/patent/US20240205106A1

## CPC

- G06Q 10/06393: {Score-carding, benchmarking or key performance indicator [KPI] analysis}
- H04L 41/5009: Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
- H04L 43/16: Threshold monitoring
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A method includes processing parameter selection inputs corresponding to a threshold correlation rule associated with monitoring a communication network. The method also includes processing node selection inputs. The method further includes causing a list of key performance indicators (KPIs) associated with monitoring the communication network to be populated based on the parameter selection inputs and the node selection inputs. The method also includes processing threshold comparison inputs and breach consistency condition inputs to generate a provisional threshold correlation rule. The method further includes processing the provisional threshold correlation rule to determine whether a previously created threshold correlation rule corresponding to a KPI exists. The method additionally includes generating the threshold correlation rule based on a confirmation to create the threshold correlation rule or a determination that the provisional threshold correlation rule does not match the previously created threshold correlation rule and storing the threshold correlation rule in a database.

## Claims

### Claim 1

A method, comprising:
processing, by a processor, one or more parameter selection inputs received by way of a graphical user interface comprising a plurality of parameter input fields, each parameter input field of the plurality of parameter input fields being configured to receive a parameter selection corresponding to a threshold correlation rule associated with monitoring a communication network;
processing one or more node selection inputs received by way of the graphical user interface;
causing a list of one or more key performance indicators (KPIs) associated with monitoring the communication network to be populated based on the one or more parameter selection inputs and the one or more node selection inputs;
causing one or more of the KPIs to be selected for inclusion in the threshold correlation rule based on a selection of one or more of the KPIs included in the list of the one or more KPIs;
processing one or more threshold comparison inputs received by way of the graphical user interface, the threshold comparison inputs comprising at least one KPI of the one or more KPIs selected for inclusion in the threshold correlation rule, a threshold comparison target to which a KPI value of the at least one KPI is compared, and a threshold comparison condition identifying a basis for comparing the KPI value of the at least one KPI to the threshold comparison target;
processing one or more breach consistency condition inputs comprising at least a minimum quantity of instances the threshold comparison condition is true indicating that an operating state of the communication network is outside a preset operating performance level that the at least one KPI is configured to indicate;
generating a provisional threshold correlation rule based on the one or more threshold comparison inputs and the one or more breach consistency condition inputs;
processing the provisional threshold correlation rule to determine whether a previously created threshold correlation rule corresponding to the at least one KPI exists in a KPI rule database that matches the provisional threshold correlation rule;
in response to a determination that a previously created threshold correlation rule exists in the KPI rule database, causing a notification to be displayed indicating that the previously created threshold correlation rule exists in the database, and requesting confirmation to create the threshold correlation rule;
generating the threshold correlation rule based on a confirmation to create the threshold correlation rule or a determination that the provisional threshold correlation rule does not match the previously created threshold correlation rule in the database;
causing the threshold correlation rule to be stored in the database;
processing system data associated with operating the communication network to determine KPI values corresponding to the at least one KPI;
comparing each KPI value corresponding to the at least one KPI to the threshold comparison target; and
in response to a determination that the operating state of the communication network is outside the preset performance level, causing an alert to be generated indicating that the operating state of the communication network is outside the preset performance level.

### Claim 2 (depends on 1)

The method of claim 1, wherein the previously created threshold correlation rule corresponding to the at least one KPI matching the provisional threshold correlation rule is determined to exist based on a determination that the one or more threshold comparison inputs and the one or more breach consistency condition inputs included in the provisional threshold correlation rule are identical to one or more threshold comparison inputs and one or more breach consistency condition inputs included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database.

### Claim 3 (depends on 1)

The method of claim 1, wherein the previously created threshold correlation rule corresponding to the at least one KPI matching the provisional threshold correlation rule is determined to exist based on a determination that the one or more threshold comparison inputs and the one or more breach consistency condition inputs included in the provisional threshold correlation rule are within a preset degree of similarity to one or more threshold comparison inputs and one or more breach consistency condition inputs included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database.

### Claim 4 (depends on 3)

The method of claim 3, wherein
the one or more breach consistency condition inputs comprise:
a first quantity of KPI values defining a first quantity of consecutive KPI values to compare to the threshold comparison target according to the threshold comparison condition to determine whether one or more of the first quantity of consecutive KPI values results in the threshold comparison condition being true; and
a second quantity of KPI values defining a first quantity of instances within the first quantity of consecutive KPI values that the threshold comparison condition being true is the minimum quantity indicating that the operating state of the communication network is outside the preset operating performance level that the at least one KPI is configured to indicate, and
the alert is caused to be generated based on a determination that first quantity of instances within the first quantity of consecutive KPI values that the threshold comparison condition is true has been reached.

### Claim 5 (depends on 4)

The method of claim 4, wherein the preset degree of similarity is based on a difference between at least one of (1) the first quantity of KPI values in the provisional threshold correlation rule and a first quantity of KPI values included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database, or (2) the second quantity of KPI values in the provisional threshold correlation rule and a second quantity of KPI values included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database.

### Claim 6 (depends on 4)

The method of claim 4, further comprising:
processing one or more closure comparison inputs received by way of the graphical user interface, the closure comparison inputs comprising at least one KPI of the one or more KPIs selected for inclusion in the threshold correlation rule, a closure comparison target to which a KPI value of the at least one KPI is compared, and a closure comparison condition identifying a basis for comparing the KPI value of the at least one KPI to the closure comparison target;
processing one or more closure consistency condition inputs comprising:
a third quantity of KPI values defining a second quantity of consecutive KPI values to compare to the closure comparison target according to the closure comparison condition to determine whether one or more of the second quantity of consecutive KPI values results in the closure comparison condition being true; and
a fourth quantity of KPI values defining a second quantity of instances within the second quantity of consecutive KPI values that the closure comparison condition being true is a minimum quantity indicating that the operating state of the communication network is within the preset operating performance level that the at least one KPI is configured to indicate;
causing the one or more closure comparison inputs and the one or more closure consistency condition inputs to be included in the threshold correlation rule; and
in response to a determination that the operating state of the communication network is within the preset performance level based on a determination that second quantity of instances within the second quantity of consecutive KPI values that the closure comparison condition is true has been reached, causing the alert to be canceled.

### Claim 7 (depends on 6)

The method of claim 6, wherein the preset degree of similarity is based on a difference between at least one of (1) the third quantity of KPI values in the provisional threshold correlation rule and a third quantity of KPI values included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database, or (2) the fourth quantity of KPI values in the provisional threshold correlation rule and a fourth quantity of KPI values included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database.

### Claim 8

An apparatus, comprising:
a processor; and
a memory having instructions stored thereon that, when executed by the processor, cause the apparatus to:
process, by a processor, one or more parameter selection inputs received by way of a graphical user interface comprising a plurality of parameter input fields, each parameter input field of the plurality of parameter input fields being configured to receive a parameter selection corresponding to a threshold correlation rule associated with monitoring a communication network;
process one or more node selection inputs received by way of the graphical user interface;
cause a list of one or more key performance indicators (KPIs) associated with monitoring the communication network to be populated based on the one or more parameter selection inputs and the one or more node selection inputs;
cause one or more of the KPIs to be selected for inclusion in the threshold correlation rule based on a selection of one or more of the KPIs included in the list of the one or more KPIs;
process one or more threshold comparison inputs received by way of the graphical user interface, the threshold comparison inputs comprising at least one KPI of the one or more KPIs selected for inclusion in the threshold correlation rule, a threshold comparison target to which a KPI value of the at least one KPI is compared, and a threshold comparison condition identifying a basis for comparing the KPI value of the at least one KPI to the threshold comparison target;
process one or more breach consistency condition inputs comprising at least a minimum quantity of instances the threshold comparison condition is true indicating that an operating state of the communication network is outside a preset operating performance level that the at least one KPI is configured to indicate;
generate a provisional threshold correlation rule based on the one or more threshold comparison inputs and the one or more breach consistency condition inputs;
process the provisional threshold correlation rule to determine whether a previously created threshold correlation rule corresponding to the at least one KPI exists in a KPI rule database that matches the provisional threshold correlation rule;
in response to a determination that a previously created threshold correlation rule exists in the KPI rule database, cause a notification to be displayed indicating that the previously created threshold correlation rule exists in the database, and request confirmation to create the threshold correlation rule;
generate the threshold correlation rule based on a confirmation to create the threshold correlation rule or a determination that the provisional threshold correlation rule does not match the previously created threshold correlation rule in the database;
cause the threshold correlation rule to be stored in the database;
process system data associated with operating the communication network to determine KPI values corresponding to the at least one KPI;
compare each KPI value corresponding to the at least one KPI to the threshold comparison target; and
in response to a determination that the operating state of the communication network is outside the preset performance level, cause an alert to be generated indicating that the operating state of the communication network is outside the preset performance level.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the previously created threshold correlation rule corresponding to the at least one KPI matching the provisional threshold correlation rule is determined to exist based on a determination that the one or more threshold comparison inputs and the one or more breach consistency condition inputs included in the provisional threshold correlation rule are identical to one or more threshold comparison inputs and one or more breach consistency condition inputs included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein the previously created threshold correlation rule corresponding to the at least one KPI matching the provisional threshold correlation rule is determined to exist based on a determination that the one or more threshold comparison inputs and the one or more breach consistency condition inputs included in the provisional threshold correlation rule are within a preset degree of similarity to one or more threshold comparison inputs and one or more breach consistency condition inputs included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein
the one or more breach consistency condition inputs comprise:
a first quantity of KPI values defining a first quantity of consecutive KPI values to compare to the threshold comparison target according to the threshold comparison condition to determine whether one or more of the first quantity of consecutive KPI values results in the threshold comparison condition being true; and
a second quantity of KPI values defining a first quantity of instances within the first quantity of consecutive KPI values that the threshold comparison condition being true is the minimum quantity indicating that the operating state of the communication network is outside the preset operating performance level that the at least one KPI is configured to indicate, and
the alert is caused to be generated based on a determination that first quantity of instances within the first quantity of consecutive KPI values that the threshold comparison condition is true has been reached.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the preset degree of similarity is based on a difference between at least one of (1) the first quantity of KPI values in the provisional threshold correlation rule and a first quantity of KPI values included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database, or (2) the second quantity of KPI values in the provisional threshold correlation rule and a second quantity of KPI values included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database.

### Claim 13 (depends on 11)

The apparatus of claim 11, wherein the apparatus is further caused to:
process one or more closure comparison inputs received by way of the graphical user interface, the closure comparison inputs comprising at least one KPI of the one or more KPIs selected for inclusion in the threshold correlation rule, a closure comparison target to which a KPI value of the at least one KPI is compared, and a closure comparison condition identifying a basis for comparing the KPI value of the at least one KPI to the closure comparison target;
process one or more closure consistency condition inputs comprising:
a third quantity of KPI values defining a second quantity of consecutive KPI values to compare to the closure comparison target according to the closure comparison condition to determine whether one or more of the second quantity of consecutive KPI values results in the closure comparison condition being true; and
a fourth quantity of KPI values defining a second quantity of instances within the second quantity of consecutive KPI values that the closure comparison condition being true is a minimum quantity indicating that the operating state of the communication network is within the preset operating performance level that the at least one KPI is configured to indicate;
cause the one or more closure comparison inputs and the one or more closure consistency condition inputs to be included in the threshold correlation rule; and
in response to a determination that the operating state of the communication network is within the preset performance level based on a determination that second quantity of instances within the second quantity of consecutive KPI values that the closure comparison condition is true has been reached, cause the alert to be canceled.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the preset degree of similarity is based on a difference between at least one of (1) the third quantity of KPI values in the provisional threshold correlation rule and a third quantity of KPI values included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database, or (2) the fourth quantity of KPI values in the provisional threshold correlation rule and a fourth quantity of KPI values included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database.

### Claim 15

A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause an apparatus to:
process, by a processor, one or more parameter selection inputs received by way of a graphical user interface comprising a plurality of parameter input fields, each parameter input field of the plurality of parameter input fields being configured to receive a parameter selection corresponding to a threshold correlation rule associated with monitoring a communication network;
process one or more node selection inputs received by way of the graphical user interface;
cause a list of one or more key performance indicators (KPIs) associated with monitoring the communication network to be populated based on the one or more parameter selection inputs and the one or more node selection inputs;
cause one or more of the KPIs to be selected for inclusion in the threshold correlation rule based on a selection of one or more of the KPIs included in the list of the one or more KPIs;
process one or more threshold comparison inputs received by way of the graphical user interface, the threshold comparison inputs comprising at least one KPI of the one or more KPIs selected for inclusion in the threshold correlation rule, a threshold comparison target to which a KPI value of the at least one KPI is compared, and a threshold comparison condition identifying a basis for comparing the KPI value of the at least one KPI to the threshold comparison target;
process one or more breach consistency condition inputs comprising at least a minimum quantity of instances the threshold comparison condition is true indicating that an operating state of the communication network is outside a preset operating performance level that the at least one KPI is configured to indicate;
generate a provisional threshold correlation rule based on the one or more threshold comparison inputs and the one or more breach consistency condition inputs;
process the provisional threshold correlation rule to determine whether a previously created threshold correlation rule corresponding to the at least one KPI exists in a KPI rule database that matches the provisional threshold correlation rule;
in response to a determination that a previously created threshold correlation rule exists in the KPI rule database, cause a notification to be displayed indicating that the previously created threshold correlation rule exists in the database, and request confirmation to create the threshold correlation rule;
generate the threshold correlation rule based on a confirmation to create the threshold correlation rule or a determination that the provisional threshold correlation rule does not match the previously created threshold correlation rule in the database;
cause the threshold correlation rule to be stored in the database;
process system data associated with operating the communication network to determine KPI values corresponding to the at least one KPI;
compare each KPI value corresponding to the at least one KPI to the threshold comparison target; and
in response to a determination that the operating state of the communication network is outside the preset performance level, cause an alert to be generated indicating that the operating state of the communication network is outside the preset performance level.

### Claim 16 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the previously created threshold correlation rule corresponding to the at least one KPI matching the provisional threshold correlation rule is determined to exist based on a determination that the one or more threshold comparison inputs and the one or more breach consistency condition inputs included in the provisional threshold correlation rule are identical to one or more threshold comparison inputs and one or more breach consistency condition inputs included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database.

### Claim 17 (depends on 15)

The non-transitory computer readable medium of claim 15, wherein the previously created threshold correlation rule corresponding to the at least one KPI matching the provisional threshold correlation rule is determined to exist based on a determination that the one or more threshold comparison inputs and the one or more breach consistency condition inputs included in the provisional threshold correlation rule are within a preset degree of similarity to one or more threshold comparison inputs and one or more breach consistency condition inputs included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database.

### Claim 18 (depends on 17)

The non-transitory computer readable medium of claim 17, wherein
the one or more breach consistency condition inputs comprise:
a first quantity of KPI values defining a first quantity of consecutive KPI values to compare to the threshold comparison target according to the threshold comparison condition to determine whether one or more of the first quantity of consecutive KPI values results in the threshold comparison condition being true; and
a second quantity of KPI values defining a first quantity of instances within the first quantity of consecutive KPI values that the threshold comparison condition being true is the minimum quantity indicating that the operating state of the communication network is outside the preset operating performance level that the at least one KPI is configured to indicate, and
the alert is caused to be generated based on a determination that first quantity of instances within the first quantity of consecutive KPI values that the threshold comparison condition is true has been reached.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein the preset degree of similarity is based on a difference between at least one of (1) the first quantity of KPI values in the provisional threshold correlation rule and a first quantity of KPI values included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database, or (2) the second quantity of KPI values in the provisional threshold correlation rule and a second quantity of KPI values included in the previously created threshold correlation rule corresponding to the at least one KPI in the KPI rule database.

### Claim 20 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein the apparatus is further caused to:
process one or more closure comparison inputs received by way of the graphical user interface, the closure comparison inputs comprising at least one KPI of the one or more KPIs selected for inclusion in the threshold correlation rule, a closure comparison target to which a KPI value of the at least one KPI is compared, and a closure comparison condition identifying a basis for comparing the KPI value of the at least one KPI to the closure comparison target;
process one or more closure consistency condition inputs comprising:
a third quantity of KPI values defining a second quantity of consecutive KPI values to compare to the closure comparison target according to the closure comparison condition to determine whether one or more of the second quantity of consecutive KPI values results in the closure comparison condition being true; and
a fourth quantity of KPI values defining a second quantity of instances within the second quantity of consecutive KPI values that the closure comparison condition being true is a minimum quantity indicating that the operating state of the communication network is within the preset operating performance level that the at least one KPI is configured to indicate;
cause the one or more closure comparison inputs and the one or more closure consistency condition inputs to be included in the threshold correlation rule; and
in response to a determination that the operating state of the communication network is within the preset performance level based on a determination that second quantity of instances within the second quantity of consecutive KPI values that the closure comparison condition is true has been reached, cause the alert to be canceled.
