# US 10,374,882 B2 · Systems and methods for identifying causes of quality degradation in wireless networks > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,374,882 B2 - Document ID: US10374882B2 - Status: Granted - Kind: B2 - Application number: 15/072,120 - Filed: 2016-03-16 - Published: 2017-09-21 - Granted: 2019-08-06 - Earliest claimed: 2016-03-16 - Assignees: Futurewei Technologies, Inc. - Applicants: Futurewei Technologies, Inc. - Inventors: Baoling S. Sheen; Ying Li; Jin Yang - Web page: https://patentgrep.com/patent/US10374882B2 ## CPC - H04L 41/0816: the condition being an adaptation, e.g. in response to network events - H04L 41/0631: using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis - H04W 24/02: Arrangements for optimising operational condition - H04W 24/10: Scheduling measurement reports {; Arrangements for measurement reports} - H04L 43/16: Threshold monitoring - H04W 24/04: Arrangements for maintaining operational condition - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract Embodiments of this disclosure filter a set of key performance indicators (KPIs) based on various criteria to reduce the number of root causes that are considered when adjusting the wireless configuration parameters. In particular, the set of KPIs may be filtered based on various criteria. In one example, KPIs having a hit-ratio below a hit-ratio threshold are removed from the set of KPIs. In another example, KPIs having a slope of linear regression below a threshold slope are removed from the set of KPIs. In yet another example, a KPI is removed from the set of KPIs when a causal relationship between the KPI and another KPI in the set of KPIs exceeds a threshold. In yet another example, a KPI is removed from the set of KPIs when the KPI has a prediction impact score that fails to exceed a prediction impact threshold. ## Claims ### Claim 1 A non-transitory computer-readable medium storing programming for execution by a processor, the programming including instructions to: receive, by a controller, a key quality indicator (KQI) and a set of key performance indicators (KPIs) associated with wireless transmissions in a wireless network area during a first period, wherein the KQI indicates quality measurement values for a set of discrete time intervals, and wherein each KPI in the set of KPIs indicates different performance measurement values for the set of discrete time intervals; remove, by the controller, from the set of KPIs, at least one KPI in accordance with hit-ratios between the KQI and KPIs in the set of KPIs, each of the hit-ratios indicating a ratio between (i) a number of discrete time intervals, during the set of discrete time intervals, in which both a value of the KQI exceeds a quality threshold and a value of a corresponding KPI in the set of KPIs exceeds a corresponding performance threshold and (ii) a total number of discrete time intervals, during the set of discrete time intervals, in which the value of the KQI exceeds the quality threshold; adjust, by the controller, configuration parameters used to communicate wireless transmissions in the wireless network area during a second period in accordance with relationships between the KQI and remaining KPIs in the set of KPIs; and send, by the controller, the adjusted configuration parameters to at least one base station, the adjusted configuration parameters being used to communicate at least one wireless transmission by the at least one base station in the wireless network area during the second period. ### Claim 2 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the instructions to remove, from the set of KPIs, the at least one KPI in accordance with hit-ratios between the KQI and KPIs in the set of KPIs include instructions to: remove, from the set of KPIs, KPIs having a hit-ratio below a hit-ratio threshold. ### Claim 3 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the programming further includes instructions to: calculate slopes of linear regression between the KQI and KPIs in the set of KPIs, each slope of linear regression indicating a degree in which a change in a value of the KQI is attributable to changes in a value of a corresponding KPI in the set of KPIs; and remove, from the set of KPIs, KPIs having a slope of linear regression below a threshold slope prior to adjusting the configuration parameters of the wireless network area in accordance with relationships between the KQI and remaining KPIs in the set of KPIs. ### Claim 4 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the programming further includes instructions to: determine global performance thresholds based on sets of KPIs reported by access points in a group of wireless network areas that includes the wireless network area, each of the global performance thresholds corresponding to a different KPI in the set of KPIs associated with wireless transmissions in the wireless network area; and remove, from the set of KPIs, KPIs failing to exceed a corresponding one of the global performance thresholds prior to adjusting the configuration parameters of the wireless network area in accordance with relationships between the KQI and remaining KPIs in the set of KPIs. ### Claim 5 (depends on 4) The non-transitory computer-readable medium of claim 4, wherein the global performance threshold comprises between an upper percentage of values for each type of KPI reported by the access points, the upper percentage being between a top twenty percent and a top five percent of KPI values. ### Claim 6 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the programming further includes instructions to: determine a causal relationship between a first KPI in the set of KPIs and a second KPI in the set of KPIs, the causal relationship indicating the degree to which a change in a value of the first KPI impacts a value of the second KPI; and remove, from the set of KPIs, the second KPI when the causal relationship between the first KPI and the second KPI satisfies a causality criteria prior to adjusting the configuration parameters of the wireless network area in accordance with relationships between the KQI and remaining KPIs in the set of KPIs. ### Claim 7 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the programming further includes instructions to: determine prediction impact scores for the set of KPIs, each of the prediction impact scores indicating a degree of accuracy impact in which a value of a corresponding KPI in the set of KPIs can be used to predict a value of the KQI; and remove, from the set of KPIs, KPIs having a prediction impact score below a prediction impact threshold prior to adjusting the configuration parameters of the wireless network area in accordance with relationships between the KQI and remaining KPIs in the set of KPIs. ### Claim 8 (depends on 7) The non-transitory computer-readable medium of claim 7, wherein the prediction impact scores are based on prediction error rates associated with KPIs in the set of KPIs. ### Claim 9 (depends on 7) The non-transitory computer-readable medium of claim 7, wherein the prediction impact scores are based on goodness of fit metrics associated with KPIs in the set of KPIs. ### Claim 10 (depends on 7) The non-transitory computer-readable medium of claim 7, wherein the prediction impact scores are based on a combination of prediction error rates and goodness of fit metrics associated with KPIs in the set of KPIs. ### Claim 11 A method for adjusting parameters of a wireless network, the method comprising: receiving, by a controller, a key quality indicator (KQI) and a set of key performance indicators (KPIs) associated with wireless transmissions in a wireless network area during a first period, wherein the KQI indicates quality measurement values for a set of discrete time intervals, and wherein each KPI in the set of KPIs indicates different performance measurement values for the set of discrete time intervals; removing, by the controller, from the set of KPIs, at least one KPI in accordance with hit-ratios between the KQI and KPIs in the set of KPIs, each of the hit-ratios indicating a ratio between (i) a number of discrete time intervals, during the set of discrete time intervals, in which both a value of the KQI exceeds a quality threshold and a value of a corresponding KPI in the set of KPIs exceeds a corresponding performance threshold and (ii) a total number of discrete time intervals, during the set of discrete time intervals, in which the value of the KQI exceeds the quality threshold; adjusting, by the controller, configuration parameters used to communicate wireless transmissions in the wireless network area during a second period in accordance with relationships between the KQI and remaining KPIs in the set of KPIs; and sending, by the controller, the adjusted configuration parameters to at least one base station, the adjusted configuration parameters being used to communicate at least one wireless transmission by the at least one base station in the wireless network area during the second period. ### Claim 12 (depends on 11) The method of claim 11, wherein removing, from the set of KPIs, the at least one KPI in accordance with hit-ratios between the KQI and KPIs in the set of KPIs comprises: removing, from the set of KPIs, KPIs having a hit-ratio below a hit-ratio threshold. ### Claim 13 (depends on 11) The method of claim 11, further comprising: calculating slopes of linear regression between the KQI and KPIs in the set of KPIs, each slope of linear regression indicating a degree in which a change in a value of the KQI is attributable to changes in a value of a corresponding KPI in the set of KPIs; and removing, from the set of KPIs, KPIs having a slope of linear regression below a threshold slope prior to adjusting the configuration parameters of the wireless network area in accordance with relationships between the KQI and remaining KPIs in the set of KPIs. ### Claim 14 (depends on 12) The method of claim 12, further comprising: determining global performance thresholds based on sets of KPIs reported by access points in a group of wireless network areas that includes the wireless network area, each of the global performance thresholds corresponding to a different KPI in the set of KPIs associated with wireless transmissions in the wireless network area; and removing, from the set of KPIs, KPIs failing to exceed a corresponding one of the global performance thresholds prior to adjusting the configuration parameters of the wireless network area in accordance with relationships between the KQI and remaining KPIs in the set of KPIs. ### Claim 15 A controller comprising: a processor; and a non-transitory computer readable storage medium storing programming for execution by the processor, the programming including instructions to: receive a key quality indicator (KQI) and a set of key performance indicators (KPIs) associated with wireless transmissions in a wireless network area during a first period, wherein the KQI indicates quality measurement values for a set of discrete time intervals, and wherein each KPI in the set of KPIs indicates different performance measurement values for the set of discrete time intervals; remove, from the set of KPIs, at least one KPI in accordance with hit-ratios between the KQI and KPIs in the set of KPIs, each of the hit-ratios indicating a ratio between (i) a number of discrete time intervals, during the set of discrete time intervals, in which both a value of the KQI exceeds a quality threshold and a value of a corresponding KPI in the set of KPIs exceeds a corresponding performance threshold and (ii) a total number of discrete time intervals, during the set of discrete time intervals, in which the value of the KQI exceeds the quality threshold; adjust configuration parameters used to communicate wireless transmissions in the wireless network area during a second period in accordance with relationships between the KQI; and send the adjusted configuration parameters to at least one base station, the adjusted configuration parameters being used to communicate at least one wireless transmission by the at least one base station in the wireless network area during the second period. ### Claim 16 (depends on 15) The controller of claim 15, wherein the instructions to remove, from the set of KPIs, the at least one KPI in accordance with hit-ratios between the KQI and KPIs in the set of KPIs include instructions to: remove, from the set of KPIs, KPIs having a hit-ratio below a hit-ratio threshold. ### Claim 17 (depends on 15) The controller of claim 15, wherein the programming further includes instructions to: calculate slopes of linear regression between the KQI and KPIs in the set of KPIs, each slope of linear regression indicating a degree in which a change in a value of the KQI is attributable to changes in a value of a corresponding KPI in the set of KPIs; and remove, from the set of KPIs, KPIs having a slope of linear regression below a threshold slope prior to adjusting the configuration parameters of the wireless network area in accordance with relationships between the KQI and remaining KPIs in the set of KPIs.