# US 2024/0179218 A1 · Determining network-specific user behavior and intent using self-supervised learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0179218 A1
- Document ID: US20240179218A1
- Status: Published application
- Kind: A1
- Application number: 18/072,267
- Filed: 2022-11-30
- Published: 2024-05-30
- Earliest claimed: 2022-11-30
- Assignees: Cisco Technology, Inc.
- Applicants: Cisco Technology, Inc.
- Inventors: Doosan Jung; Qihong Shao; Miriam Wagner Valladolid
- Web page: https://patentgrep.com/patent/US20240179218A1

## CPC

- H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)}
- G06N 20/00: Machine learning
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Methods are provided for generating recommendations related to a network domain by performing self-supervised machine learning using masked modeling of input data related to user interactions with the network domain and/or network related information. Specifically, a computing device obtains input data including one or more of network information indicative of a plurality of network devices in a network domain and user behavior information indicative of one or more user interactions with the network domain. The computing device performs a self-supervised machine learning using mask modeling of a plurality of elements that represent the input data, to determine contextual meaning of the input data and generating at least one actionable task related to the network domain based on the contextual meaning of the input data. The computing device further provides the at least one actionable task for performing one or more actions associated with the network domain.

## Claims

### Claim 1

A method comprising:
obtaining, by a computing device, input data including one or more of network information indicative of a plurality of network devices in a network domain and user behavior information indicative of one or more user interactions with the network domain;
performing, by the computing device, a self-supervised machine learning using mask modeling of a plurality of elements that represent the input data, to determine contextual meaning of the input data;
generating at least one actionable task related to the network domain based on the contextual meaning of the input data; and
providing, by the computing device, the at least one actionable task for performing one or more actions associated with the network domain.

### Claim 2 (depends on 1)

The method of claim 1, wherein providing the at least one actionable task for performing the one or more actions includes one or more of:
providing at least one shortcut for executing the one or more actions that relate to a configuration or management of the network domain;
providing guided support for performing the at least one actionable task by sequentially providing or executing a next action from the one or more actions; or
providing a first path for performing the at least one actionable task, the first path includes the one or more actions and is faster than a second path for performing the at least one actionable task.

### Claim 3 (depends on 1)

The method of claim 1, wherein the input data includes the network information and the user behavior information and further comprising:
determining device similarities of the plurality of network devices and behavioral similarities between the one or more user interactions, based on the contextual meaning of the input data,
wherein generating the at least one actionable task includes generating at least one of:
a first action related to at least one network device in the network domain that is similar to one of the plurality of network devices based on the device similarities,
a second action related to a user behavior that is similar to a behavior defined by the one or more user interactions based on the behavioral similarities, or
a third action to be performed on the at least one network device that is related to the user behavior, based on the device similarities and the behavioral similarities.

### Claim 4 (depends on 1)

The method of claim 1, wherein the input data includes the user behavior information in a form of click-through stream data and further comprising:
embedding one or more event sequences in the click-through stream data to generate an event embedding structure that includes the contextual meaning of a respective event, a sequence of the respective event, and a position of the respective event in the sequence,
wherein performing the self-supervised machine learning includes the mask modeling of the event embedding structure.

### Claim 5 (depends on 4)

The method of claim 4, wherein embedding the one or more event sequences further comprises:
generating grouping information for the click-through stream data by grouping the one or more event sequences into one or more groups based on at least one attribute that includes one or more of an identity of a user that generated the respective event, a role of the user within the network domain, an enterprise of the user, and a geolocation of the user; and
embedding the grouping information into the event embedding structure.

### Claim 6 (depends on 5)

The method of claim 5, wherein generating the grouping information includes:
determining the at least one attribute of the click-through stream data based on clustering the one or more event sequences in the event embedding structure.

### Claim 7 (depends on 4)

The method of claim 4, wherein performing the self-supervised machine learning includes:
iteratively training the event embedding structure by replacing an element in the event embedding structure with a masked token to determine the contextual meaning of a user behavior defined by the one or more user interactions.

### Claim 8 (depends on 7)

The method of claim 7, wherein performing the self-supervised machine learning further includes:
iteratively training the event embedding structure using an adjacent sequence prediction to determine one or more relationships between the one or more user interactions.

### Claim 9 (depends on 1)

The method of claim 1, wherein the input data includes the network information and further comprising:
embedding the network information indicative of the plurality of network devices to generate a network embedding structure that includes the contextual meaning of a respective network device, an enterprise site of the respective network device, and a connection of the respective network device to other network devices in the network domain,
wherein performing the self-supervised machine learning includes the mask modeling of the network embedding structure.

### Claim 10 (depends on 9)

The method of claim 9, wherein the network embedding structure includes topology of the network domain defined by embedding the connection of the respective network device for each of the plurality of network devices using an adjacency matrix.

### Claim 11 (depends on 9)

The method of claim 9, wherein performing the self-supervised machine learning includes:
iteratively training the network embedding structure by replacing one of the plurality of network devices in the network embedding structure with a masked token to determine the contextual meaning of the plurality of network devices including one or more of a device type, a device role in the network domain, a device function, or a device product family type.

### Claim 12 (depends on 11)

The method of claim 11, wherein performing the self-supervised machine learning further includes:
iteratively training the network embedding structure using an adjacent sequence prediction to determine one or more relationships between a plurality of enterprise sites in the network domain.

### Claim 13

An apparatus comprising:
a memory;
a network interface configured to enable network communications; and
a processor, wherein the processor is configured to perform a method comprising:
obtaining input data including one or more of network information indicative of a plurality of network devices in a network domain and user behavior information indicative of one or more user interactions with the network domain;
performing a self-supervised machine learning using mask modeling of a plurality of elements that represent the input data, to determine contextual meaning of the input data;
generating at least one actionable task related to the network domain based on the contextual meaning of the input data; and
providing the at least one actionable task for performing one or more actions associated with the network domain.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the processor is configured to provide the at least one actionable task for performing the one or more actions by providing one or more of:
at least one shortcut for executing the one or more actions that relate to a configuration or management of the network domain;
guided support for performing the at least one actionable task by sequentially providing or executing a next action from the one or more actions; or
a first path for performing the at least one actionable task, the first path includes the one or more actions and is faster than a second path for performing the at least one actionable task.

### Claim 15 (depends on 13)

The apparatus of claim 13, wherein the input data includes the network information and the user behavior information and the processor is further configured to perform:
determining device similarities of the plurality of network devices and behavioral similarities between the one or more user interactions, based on the contextual meaning of the input data,
wherein the processor is configured to generate the at least one actionable task by generating at least one of:
a first action related to at least one network device in the network domain that is similar to one of the plurality of network devices based on the device similarities,
a second action related to a user behavior that is similar to a behavior defined by the one or more user interactions based on the behavioral similarities, or
a third action to be performed on the at least one network device that is related to the user behavior, based on the device similarities and the behavioral similarities.

### Claim 16 (depends on 13)

The apparatus of claim 13, wherein the input data includes the user behavior information in a form of click-through stream data and the processor is further configured to perform:
embedding one or more event sequences in the click-through stream data to generate an event embedding structure that includes the contextual meaning of a respective event, a sequence of the respective event, and a position of the respective event in the sequence,
wherein the processor performs the self-supervised machine learning by the mask modeling of the event embedding structure.

### Claim 17 (depends on 13)

The apparatus of claim 13, wherein the input data includes the network information and the processor is further configured to perform:
embedding the network information indicative of the plurality of network devices to generate a network embedding structure that includes the contextual meaning of a respective network device, an enterprise site of the respective network device, and a connection of the respective network device to other network devices in the network domain,
wherein the processor performs the self-supervised machine learning by the mask modeling of the network embedding structure.

### Claim 18

One or more non-transitory computer readable storage media encoded with software comprising computer executable instructions that, when executed by a processor, cause the processor to perform a method including:
obtaining input data including one or more of network information indicative of a plurality of network devices in a network domain and user behavior information indicative of one or more user interactions with the network domain;
performing a self-supervised machine learning using mask modeling of a plurality of elements that represent the input data, to determine contextual meaning of the input data;
generating at least one actionable task related to the network domain based on the contextual meaning of the input data; and
providing the at least one actionable task for performing one or more actions associated with the network domain.

### Claim 19 (depends on 18)

The one or more non-transitory computer readable storage media according to claim 18, wherein the computer executable instructions cause the processor to provide the at least one actionable task for performing the one or more actions by providing one or more of:
at least one shortcut for executing the one or more actions that relate to a configuration or management of the network domain;
guided support for performing the at least one actionable task by sequentially providing or executing a next action from the one or more actions; or
a first path for performing the at least one actionable task, the first path includes the one or more actions and is faster than a second path for performing the at least one actionable task.

### Claim 20 (depends on 18)

The one or more non-transitory computer readable storage media according to claim 18, wherein the input data includes the network information and the user behavior information and the computer executable instructions cause the processor to further perform:
determining device similarities of the plurality of network devices and behavioral similarities between the one or more user interactions, based on the contextual meaning of the input data,
wherein the processor generates the at least one actionable task by generating at least one of:
a first action related to at least one network device in the network domain that is similar to one of the plurality of network devices based on the device similarities,
a second action related to a user behavior that is similar to a behavior defined by the one or more user interactions based on the behavioral similarities, or
a third action to be performed on the at least one network device that is related to the user behavior, based on the device similarities and the behavioral similarities.

### Claim 21 (depends on 18)

The one or more non-transitory computer readable storage media according to claim 18, wherein the input data includes the user behavior information in a form of click-through stream data and the computer executable instructions cause the processor to further perform:
embedding one or more event sequences in the click-through stream data to generate an event embedding structure that includes the contextual meaning of a respective event, a sequence of the respective event, and a position of the respective event in the sequence,
wherein the processor performs the self-supervised machine learning by the mask modeling of the event embedding structure.
