# US 2021/0279632 A1 · Using raw network telemetry traces to generate predictive insights using machine learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279632 A1
- Document ID: US20210279632A1
- Status: Published application
- Kind: A1
- Application number: 16/809,060
- Filed: 2020-03-04
- Published: 2021-09-09
- Earliest claimed: 2020-03-04
- Assignees: Cisco Technology, Inc.
- Applicants: Cisco Technology, Inc.
- Inventors: Andrea Di Pietro; Javier Cruz Mota; Sukrit Dasgupta; Jean-Philippe Vasseur
- Web page: https://patentgrep.com/patent/US20210279632A1

## CPC

- H04L 41/16: using machine learning or artificial intelligence
- G06N 5/04: Inference or reasoning models
- G06N 20/00: Machine learning
- H04L 41/142: using statistical or mathematical methods
- H04L 41/147: for predicting network behaviour
- H04L 41/22: comprising specially adapted graphical user interfaces [GUI]
- H04L 43/08: Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

In one embodiment, a service receives telemetry data collected from a plurality of different networks. The service combines the telemetry data into a synthetic input trace. The service inputs the synthetic input trace into a plurality of machine learning models to generate a plurality of predicted key performance indicators (KPIs), each of the models having been trained to assess telemetry data from an associated network in the plurality of different networks and predict a KPI for that network. The service compares the plurality of predicted KPIs to identify one of the plurality of different networks as exhibiting an abnormal behavior.

## Claims

### Claim 1

A method comprising:
receiving, at a service, telemetry data collected from a plurality of different networks;
combining, by the service, the telemetry data into a synthetic input trace;
inputting, by the service, the synthetic input trace into a plurality of machine learning models to generate a plurality of predicted key performance indicators (KPIs), each of the models having been trained to assess telemetry data from an associated network in the plurality of different networks and predict a KPI for that network; and
comparing, by the service, the plurality of predicted KPIs to identify one of the plurality of different networks as exhibiting an abnormal behavior.

### Claim 2 (depends on 1)

The method as in claim 1, further comprising:
providing, by the service, an indication of the identified network as exhibiting an abnormal behavior to a user interface.

### Claim 3 (depends on 2)

The method as in claim 2, further comprising:
receiving, at the service and via the user interface, one or more parameters that specify the telemetry data to be combined into the synthetic input trace.

### Claim 4 (depends on 1)

The method as in claim 1, wherein comparing, by the service, the plurality of predicted KPIs to identify one of the plurality of different networks as exhibiting an abnormal behavior comprises:
determining that the predicted KPI for the identified network is a statistical outlier among the predicted KPIs for the plurality of different networks.

### Claim 5 (depends on 1)

The method as in claim 1, further comprising:
retrieving, by the service, the plurality of machine learning models from the plurality of different networks.

### Claim 6 (depends on 1)

The method as in claim 1, wherein combining, by the service, the telemetry data into the synthetic input trace comprises:
performing clustering on the telemetry data received from the plurality of different networks using a defined similarity metric.

### Claim 7 (depends on 1)

The method as in claim 1, wherein combining, by the service, the telemetry data into the synthetic input trace comprises:
performing clustering on the telemetry data received from the plurality of different networks using a defined similarity metric.

### Claim 8 (depends on 1)

The method as in claim 1, further comprising:
splitting, by the service, the telemetry data into sub-sections representative of different network conditions.

### Claim 9 (depends on 8)

The method as in claim 8, wherein the different network conditions are associated with at least one of: a particular timeframe or a number of network clients.

### Claim 10

An apparatus, comprising:
one or more network interfaces;
a processor coupled to the network interfaces and configured to execute one or more processes; and
a memory configured to store a process executable by the processor, the process when executed configured to:
receive telemetry data collected from a plurality of different networks;
combine the telemetry data into a synthetic input trace;
input the synthetic input trace into a plurality of machine learning models to generate a plurality of predicted key performance indicators (KPIs), each of the models having been trained to assess telemetry data from an associated network in the plurality of different networks and predict a KPI for that network; and
compare the plurality of predicted KPIs to identify one of the plurality of different networks as exhibiting an abnormal behavior.

### Claim 11 (depends on 10)

The apparatus as in claim 10, wherein the process when executed is further configured to:
provide an indication of the identified network as exhibiting an abnormal behavior to a user interface.

### Claim 12 (depends on 11)

The apparatus as in claim 11, wherein the process when executed is further configured to:
receive via the user interface, one or more parameters that specify the telemetry data to be combined into the synthetic input trace.

### Claim 13 (depends on 10)

The apparatus as in claim 10, wherein the apparatus compares the plurality of predicted KPIs to identify one of the plurality of different networks as exhibiting an abnormal behavior by:
determining that the predicted KPI for the identified network is a statistical outlier among the predicted KPIs for the plurality of different networks.

### Claim 14 (depends on 10)

The apparatus as in claim 10, wherein the process when executed is further configured to:
retrieve the plurality of machine learning models from the plurality of different networks.

### Claim 15 (depends on 10)

The apparatus as in claim 10, wherein the apparatus combines the telemetry data into the synthetic input trace by:
performing clustering on the telemetry data received from the plurality of different networks using a defined similarity metric.

### Claim 16 (depends on 10)

The apparatus as in claim 10, wherein the apparatus combines the telemetry data into the synthetic input trace by:
performing clustering on the telemetry data received from the plurality of different networks using a defined similarity metric.

### Claim 17 (depends on 10)

The apparatus as in claim 10, wherein the process when executed is further configured to:
split the telemetry data into sub-sections representative of different network conditions.

### Claim 18 (depends on 17)

The apparatus as in claim 17, wherein the different network conditions are associated with at least one of: a particular timeframe or a number of network clients.

### Claim 19

A tangible, non-transitory, computer-readable medium storing program instructions that cause a service to execute a process comprising:
receiving, at the service, telemetry data collected from a plurality of different networks;
combining, by the service, the telemetry data into a synthetic input trace;
inputting, by the service, the synthetic input trace into a plurality of machine learning models to generate a plurality of predicted key performance indicators (KPIs), each of the models having been trained to assess telemetry data from an associated network in the plurality of different networks and predict a KPI for that network; and
comparing, by the service, the plurality of predicted KPIs to identify one of the plurality of different networks as exhibiting an abnormal behavior.

### Claim 20 (depends on 19)

The computer-readable medium as in claim 19, wherein the process further comprises:
providing, by the service, an indication of the identified network as exhibiting an abnormal behavior to a user interface.
