# US 2023/0155960 A1 · Network monitoring system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0155960 A1
- Document ID: US20230155960A1
- Status: Published application
- Kind: A1
- Application number: 17/986,735
- Filed: 2022-11-14
- Published: 2023-05-18
- Earliest claimed: 2021-11-12
- Assignees: Research & Business Foundation Sungkyunkwan University
- Applicants: Research & Business Foundation Sungkyunkwan University
- Inventors: Young Seok LEE; Woo Kyung KIM; Sung Hyun CHOI; Ik Jun YEOM; Hong Uk WOO
- Web page: https://patentgrep.com/patent/US20230155960A1

## CPC

- H04L 47/805: {QOS or priority aware}
- H04L 47/83: based on usage prediction
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

The present disclosure provides a network monitoring system including a plurality of sensor devices which transmits data packets and a monitoring server which performs the transferable reinforcement learning on the data packets to establish a bandwidth allocation policy in which a quality of experience (QoE) satisfies a set reference QoE to allocate the bandwidth to the plurality of sensor devices.

## Claims

### Claim 1

A network monitoring system, comprising:
a plurality of sensor devices which transmits data packets; and
a monitoring server which performs the transferable reinforcement learning on the data packets to establish a bandwidth allocation policy in which a quality of experience (QoE) satisfies a set reference QoE to allocate the bandwidth to the plurality of sensor devices.

### Claim 2 (depends on 1)

The network monitoring system according to claim 1, wherein the monitoring server includes:
a storage unit which stores the data packets and the bandwidth allocated to the plurality of sensor devices; and
a learning unit which computes the QoE quality by applying the data packets stored in the monitoring server to the bandwidth allocation policy generated with the transferable reinforcement learning, and allocates the bandwidth which satisfies the reference QoE quality.

### Claim 3 (depends on 2)

The network monitoring system according to claim 2, wherein the learning unit includes:
a flow embedding module which applies a flow state of the data packets to an attention mechanism configured by multi-perceptron to output a vector value which accelerates the training speed; and
a bandwidth allocation module which forms a latent action which reduces an action search space to accelerate the training speed based on the vector value and a final action which expresses the latent action with a bandwidth allocation value.

### Claim 4 (depends on 3)

The network monitoring system according to claim 3, wherein the flow embedding module includes a vectorization function which generates an intermediate embedding vector value by applying the flow state to a multilayer perceptron and a relation extraction function which generates the vector value which is a flow embedding weighted by applying the intermediate embedding vector value to an attention mechanism.

### Claim 5 (depends on 3)

The network monitoring system according to claim 3, wherein the bandwidth allocation module includes an allocation function which forms the latent action according to a position point with respect to the plurality of sensor devices, an adaptation function which derives a control value to allow the latent action to be adapted to the plurality of target network environments, and a sharing function which forms the final action with the latent action and the control value.

### Claim 6 (depends on 5)

The network monitoring system according to claim 5, wherein the bandwidth allocation module establishes the bandwidth allocation policy in which the QoE quality satisfies the reference QoE quality according to the final action to allocate the bandwidth to the plurality of sensor devices with a data allocation value which represents the final action.
