# US 2019/0173761 A1 · Automated and adaptive generation of test stimuli for a network or system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0173761 A1
- Document ID: US20190173761A1
- Status: Published application
- Kind: A1
- Application number: 15/829,139
- Filed: 2017-12-01
- Published: 2019-06-06
- Earliest claimed: 2017-12-01
- Assignees: Cisco Technology, Inc.
- Applicants: Cisco Technology, Inc.
- Inventors: Charles Calvin Byers; Joseph Michael Clarke; Gonzalo Salgueiro; M. David Hanes
- Web page: https://patentgrep.com/patent/US20190173761A1

## CPC

- H04L 43/50: Testing arrangements
- H04L 41/14: Network analysis or design
- H04L 41/142: using statistical or mathematical methods
- H04L 41/12: Discovery or management of network topologies
- H04L 41/16: using machine learning or artificial intelligence
- H04L 43/10: Active monitoring, e.g. heartbeat, ping or trace-route
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Automatic, adaptive stimulus generation includes receiving, at a network device that is associated with a network or system, analytics data that provides an indication of how the network or system is responding to a set of test stimuli introduced into the network or system to facilitate an analysis operation. The network device analyzes the analytics data based on an intended objective for the analysis operation and generates control settings based on the analyzing. The control settings control creation of a subsequent stimulus to be introduced into the network or system during subsequent execution of the analysis operation.

## Claims

### Claim 1

A method comprising:
receiving, at a network device that is associated with a network or system, analytics data that provides an indication of how the network or system is responding to a set of test stimuli introduced into the network or system to facilitate an analysis operation;
analyzing the analytics data based on an intended objective for the analysis operation; and
generating, based on the analyzing, control settings for controlling creation of a subsequent stimulus to be introduced into the network or system during subsequent execution of the analysis operation.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
transmitting the control settings to a device or function configured to cause the subsequent stimulus to be introduced into the network or system.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
transmitting the control settings to an analytics system or function to cause the analytics system or function to generate subsequent analytics data based on the subsequent stimulus introduced into to the network or system.

### Claim 4 (depends on 3)

The method of claim 3, wherein the analyzing employs machine learning techniques, and the method further comprises:
receiving the subsequent analytics data;
analyzing the subsequent analytics data with the machine learning techniques based on the intended objective or a modified objective determined by the machine learning techniques; and
generating, based on the analyzing of the subsequent analytics data, at least one of: (a) subsequent control settings for controlling creation of the subsequent stimulus to be introduced into the network or system; or (b) a new prioritization of the subsequent stimulus to be introduced into the network or system.

### Claim 5 (depends on 1)

The method of claim 1, wherein the analytics data comprises:
feedback data from an analytics system or function associated with the network or system; and
feedback data from an analytics machine learning system associated with the analytics system or function.

### Claim 6 (depends on 5)

The method of claim 5, further comprises:
transmitting the control settings to the analytics machine learning system to update analytics machine learning techniques applied by the analytics machine learning system.

### Claim 7 (depends on 1)

The method of claim 1, wherein the receiving, the analyzing, and the generating are completed automatically during at least one of: (a) creation of the network or system; (b) regular operations of the network or system; or (c) abnormal operations of the network or system.

### Claim 8

A system comprising:
an analytics subsystem associated with a network or system that:
analyzes responses of the network or system to a set of test stimuli introduced into the network or system to facilitate an analysis operation; and
generates analytics data based on the analysis; and
a stimulitics subsystem associated with the network or system that:
receives the analytics data from at least the analytics subsystem;
analyzes the analytics data based on an intended objective for the analysis operation; and
generates, based on the analyzing of the analytics data, control settings for controlling creation of a subsequent stimulus to be introduced into the network or system during subsequent execution of the analysis operation.

### Claim 9 (depends on 8)

The system of claim 8, further comprising:
a stimulus generation subsystem associated with the network or system,
wherein the stimulitics subsystem further:
transmits the control settings to the stimulus generation subsystem to cause the stimulus generation subsystem to introduce the subsequent stimulus into the network or system.

### Claim 10 (depends on 9)

The system of claim 9, wherein the stimulitics subsystem further:
transmits the control settings to the analytics subsystem to cause the analytics subsystem to generate subsequent analytics data based on the subsequent stimulus introduced into the network or system.

### Claim 11 (depends on 10)

The system of claim 10, wherein the stimulitics subsystem employs machine learning techniques, and wherein the stimulitics subsystem further:
analyzes the subsequent analytics data with the machine learning techniques based on the intended objective or a modified objective determined by the machine learning techniques; and
generates, based on the analyzing of the subsequent analytics data, at least one of: (a) subsequent control settings for controlling creation of the subsequent stimulus to be introduced into the network or system; or (b) a new prioritization of the subsequent stimulus to be introduced into the network or system.

### Claim 12 (depends on 8)

The system of claim 8, further comprising:
an analytics machine learning subsystem associated with the analytics subsystem,
wherein the stimulitics subsystem:
receives the analytics data from the analytics subsystem and the analytics machine learning subsystem.

### Claim 13 (depends on 12)

The system of claim 12, wherein the stimulitics subsystem further:
transmits the control settings to the analytics machine learning subsystem to update analytical machine learning techniques applied by the analytics machine learning subsystem.

### Claim 14 (depends on 10)

The system of claim 10, wherein the system operates automatically during at least one of: (a) creation of the network or system; (b) regular operations of the network or system; or (c) abnormal operations of the network or system.

### Claim 15

One or more non-transitory computer readable storage media encoded with software comprising computer executable instructions and when the software is executed operable to:
receive analytics data that provides an indication of how a network or system is responding to a set of stimuli introduced into the network or system to facilitate an analysis operation;
analyze the analytics data based on an intended objective for the analysis operation; and
generate, based on the analyzing, control settings for controlling creation of a subsequent stimulus to be introduced into the network or system during subsequent execution of the analysis operation.

### Claim 16 (depends on 15)

The one or more non-transitory computer readable storage media of claim 15, further comprising instructions operable to:
transmit the control settings to a device or function configured to introduce the subsequent stimulus into the network or system.

### Claim 17 (depends on 16)

The one or more non-transitory computer readable storage media of claim 16, further comprising instructions operable to:
transmit the control settings to an analytics system or function to cause the analytics system or function to generate subsequent analytics data based on the subsequent stimulus introduced into to the network or system.

### Claim 18 (depends on 17)

The one or more non-transitory computer readable storage media of claim 17, wherein the instructions to analyze employ machine learning techniques and the instructions further comprising instructions operable to:
receive the subsequent analytics data;
analyze the subsequent analytics data with the machine learning techniques based on the intended objective or a modified objective determined by the machine learning techniques; and
generate, based on the analyzing of the subsequent analytics data, at least one of: (a) subsequent control settings for controlling creation of the subsequent stimulus to be introduced into the network or system; or (b) a new prioritization of the subsequent stimulus to be introduced into the network or system.

### Claim 19 (depends on 15)

The one or more non-transitory computer readable storage media of claim 15, wherein the analytics data comprises:
feedback data from an analytics system or function associated with the network or system; and
feedback data from an analytics machine learning system associated with the analytics system or function.

### Claim 20 (depends on 15)

The one or more non-transitory computer readable storage media of claim 15, wherein the instructions are executed automatically during at least one of: (a) creation of the network or system; (b) regular operations of the network or system; or (c) abnormal operations of the network or system.
