# US 2020/0287814 A1 · Training method and apparatus for service quality assessment model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0287814 A1
- Document ID: US20200287814A1
- Status: Published application
- Kind: A1
- Application number: 16/766,738
- Filed: 2018-10-30
- Published: 2020-09-10
- Earliest claimed: 2018-10-17
- Assignees: Wangsu Science & Technology Co., Ltd.
- Applicants: Wangsu Science & Technology Co., Ltd.
- Inventors: Rui ZHAO
- Web page: https://patentgrep.com/patent/US20200287814A1

## CPC

- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06F 18/2178: {based on feedback of a supervisor}
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/048: Activation functions
- G06N 3/08: Learning methods
- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06N 3/09: Supervised learning
- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- H04L 41/5009: Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
- H04L 43/0817: by checking functioning
- H04L 43/0876: Network utilisation, e.g. volume of load or congestion level
- H04L 43/10: Active monitoring, e.g. heartbeat, ping or trace-route
- H04L 43/50: Testing arrangements
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

The present invention provides a training method and a training apparatus for a service quality assessment model. The method includes: collecting machine performance data, network characteristics data, and quality monitoring data of service nodes according to a fixed cycle; determining an eigenvalue based on the machine performance data and the network characteristics data; determining target quality data based on the quality monitoring data; using the eigenvalue and the target quality data to establish a training dataset; and using the training dataset to construct the service quality assessment model.

## Claims

### Claim 1

A training method for a service quality assessment model applicable for a model training node, comprising:
collecting machine performance data, network characteristics data, and quality monitoring data of service nodes according to a fixed cycle;
determining an eigenvalue based on the machine performance data and the network characteristics data;
determining target quality data based on the quality monitoring data;
using the eigenvalue and the target quality data to establish a training dataset; and
using the training dataset to construct the service quality assessment model.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
each service quality assessment model is applicable for assessing a service type; and
correspondingly, collecting the quality monitoring data of the service nodes according to the fixed cycle includes:
collecting, according to the fixed cycle, the quality monitoring data of the service nodes corresponding to one or more application services belonging to a service type applicable for the service quality assessment model.

### Claim 3 (depends on 1)

The method of claim 1, wherein:
the machine performance data include a CPU utilization rate, a memory utilization rate, and input/output information; and
the network characteristics data include ping data, poll data, and a downloading speed.

### Claim 4 (depends on 1)

The method of claim 1, wherein:
a monitoring node periodically sends testing signals to the service nodes to obtain the network characteristics data; and
correspondingly, collecting the network characteristics data of the service nodes according to the fixed cycle includes:
collecting the network characteristics data of the service nodes from the monitoring node according to the fixed cycle.

### Claim 5 (depends on 1)

The method of claim 1, before determining the eigenvalue based on the machine performance data and the network characteristics data, further including:
screening missing values and corrupted values from the machine performance data, the network characteristics data, the quality monitoring data; and
replacing the missing values and the corrupted values with correct values.

### Claim 6 (depends on 5)

The method of claim 5, wherein:
screening the missing values and the corrupted values from the machine performance data, the network characteristics data, the quality monitoring data includes using a clustering algorithm or configuring a confidence range after the collected data are standardized to screen the missing values and the corrupted values from the machine performance data, the network characteristics data, the quality monitoring data; and
replacing the corrupted values with the correct values includes using a k-NN method or data collected in adjacent collection cycles to replace the corrupted values.

### Claim 7 (depends on 1)

The method of claim 1, wherein:
the eigenvalue includes the machine performance data, one or more of mean values, median values, or variance values of various dimensions of the machine performance data, the network characteristics data, and one or more of mean values, median values, or variance values of various dimensions of the network characteristics data.

### Claim 8 (depends on 1)

The method of claim 1, wherein determining the target quality data based on the quality monitoring data includes:
determining assessment indicators of service quality based on the service type applicable for the service quality assessment model; and
using the quality monitoring data to calculate values of the assessment indicators and determining the values of the assessment indicators as the target quality data.

### Claim 9 (depends on 1)

The method of claim 1, wherein using the training dataset to construct the service quality assessment model includes:
using the training dataset to train a deep neural network to construct the service quality assessment model, wherein the deep neural network is a deep residual network.

### Claim 10 (depends on 9)

The method of claim 9, wherein:
the training dataset includes a plurality of training samples; and
each training sample includes the eigenvalue of m number of the temporal steps and the target quality data, wherein m is a positive integer.

### Claim 11 (depends on 10)

The method of claim 10, wherein using the training dataset to train the deep residual network includes:
inputting the eigenvalues of the training samples to the deep residual network in turn to obtain quality data;
determining an error between the quality data and the target quality data; and
backward propagating the error to optimize hyperparameters of a model.

### Claim 12 (depends on 9)

The method of claim 9, wherein:
the deep residual network includes an input layer, a first total connection layer, a convolution layer, a preset number of residual blocks, a second total connection layer, and an output layer.

### Claim 13 (depends on 12)

The method of claim 12, wherein using the training dataset to train the deep residual network includes:
inputting the eigenvalues of the training samples to the first total connection layer to be divided and compressed, and outputting new features.

### Claim 14 (depends on 12)

The method of claim 12, wherein:
the convolution layer has a plurality of channels.

### Claim 15 (depends on 12)

The method of claim 12, wherein using the training dataset to train the deep residual network further includes:
inputting data outputted from the convolution layer to the preset number of residual blocks in turn for further processing, wherein data processing in each residual block includes:
inputting, in turn, data inputted to the residual block to a 1*1 convolution layer having a number of channels, a 1*3 convolution layer having b number of channels, and a 1*1 convolution layer having c number of channels, wherein a, b, and c are positive integers;
summing data outputted from the 1*1 convolution layer having c number of channels and data inputted to the 1*1 convolution layer having a number of channels; and
stimulating the summed data by a Relu function.

### Claim 16 (depends on 12)

The method of claim 12, wherein using the training dataset to train the deep residual network further includes:
inputting data outputted from the last one of the preset number of residual blocks to the second total connection layer to perform a non-linear transformation to obtain the quality data.

### Claim 17 (depends on 1)

The method of claim 1, wherein:
the method further includes using the eigenvalue and the target quality data to establish a testing dataset; and
using the training dataset to construct the service quality assessment model includes:
according to the training dataset established based on history data, performing model training;
according to the testing dataset, validating an effectiveness of fitting a trained model;
if the effectiveness does not satisfy a preset requirement, adjusting the hyperparameters and repeating the model training iteratively;
if the effectiveness satisfies the preset requirement, terminating the model training to obtain the service quality assessment model; and
using the training dataset established based on real-time data to continue to train the service quality assessment model to optimize the hyperparameters of the service quality assessment model.

### Claim 18 (depends on 1)

The method of claim 1, wherein:
a relationship between inputted data and outputted result established by the service quality assessment model is a non-linear relationship.

### Claim 19 (depends on 1)

The method of claim 1, wherein:
the model training node is a single server or a group of servers.

### Claim 20

A training apparatus for a service quality assessment model, comprising:
a collecting module configured to collect machine performance data, network characteristics data, and quality monitoring data of service nodes according to a fixed cycle;
a processing module configured to determine an eigenvalue based on the machine performance data and the network characteristics data, to determine target quality data based on the quality monitoring data, and to use the eigenvalue and the target quality data to establish a training dataset; and
a training module configured to use the training dataset to construct the service quality assessment model.

### Claim at position 21

21-31. (canceled)
