# US 2021/0345134 A1 · Handling of machine learning to improve performance of a wireless communications network

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0345134 A1
- Document ID: US20210345134A1
- Status: Published application
- Kind: A1
- Application number: 17/286,287
- Filed: 2018-10-19
- Published: 2021-11-04
- Earliest claimed: 2018-10-19
- Assignees: Telefonaktiebolaget LM Ericsson (publ)
- Applicants: Telefonaktiebolaget LM Ericsson (publ)
- Inventors: Johan OTTERSTEN; Hugo TULLBERG
- Web page: https://patentgrep.com/patent/US20210345134A1

## CPC

- H04W 16/22: Traffic simulation tools or models
- H04W 24/02: Arrangements for optimising operational condition
- G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
- G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
- G06N 3/0499: Feedforward networks
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G06N 3/092: Reinforcement learning
- G06N 3/098: Distributed learning, e.g. federated learning
- G06N 5/04: Inference or reasoning models
- G06N 20/00: Machine learning
- H04W 24/08: Testing, {supervising or monitoring} using real traffic
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- H04L 47/127: by using congestion prediction
- H04W 28/0231: {based on communication conditions (dynamic wireless traffic scheduling definition based on channel quality criteria H04W72/54)}
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A wireless communications system and a method therein for handling of machine learning. The system includes a central node and one or more intermediate nodes arranged between the central node and one or more leaf nodes. Further, at least one out of the nodes includes a machine learning unit. The system determines, by means of the machine learning unit and a machine learning model relating to at least one node out of the one or more intermediate nodes or the one or more leaf nodes, a prediction of a performance of the at least one node based on input data relating to the at least one node. Further, the system performs, based on the determined prediction, an operation relating to the at least one node, and communicates the determined prediction and/or information relating to the machine learning model to one or more other nodes.

## Claims

### Claim 1

A method performed in a wireless communications system for handling of machine learning to improve performance of a wireless communications network operating in the wireless communications system, the wireless communications system comprising a central network node and one or more intermediate network nodes arranged between the central network node and one or more leaf network nodes operating in the wireless communications network, at least one out of: the central network node, the one or more intermediate network nodes or the one or more leaf network nodes comprising a machine learning unit, the method comprising:
by means of the machine learning unit and a machine learning model relating to at least one network node out of the one or more intermediate network nodes or the one or more leaf network nodes, determining a prediction of a performance of the at least one network node based on input data relating to the at least one network node;
based on the determined prediction, performing one or more operations relating to the at least one network node; and
transmitting at least one of the determined prediction and information relating to the machine learning model to one or more other network nodes.

### Claim 2 (depends on 1)

The method of claim 1, wherein a leaf network node is a communications device connected to an intermediate network node being a radio network node, wherein the method further comprises:
when the communications device connects to the radio network node, the communications device transmits information relating to one or more objectives of the communications device;
transmitting, from the radio network node to the communications device, a machine learning model suitable for the communications device's one or more objectives;
by means of the radio network node, requesting the communications device to collect data to be used as input data for training of a machine learning model relating to the communications device;
transmitting from the communications device to the radio network node the collected data; and
by means of the radio network node and based on the collected data, updating the machine learning model suitable for the communications device's one or more objectives.

### Claim 3 (depends on 1)

The method of claim 1, wherein a respective first and second leaf network node is a respective first and second communications device connected to an intermediate network node being a radio network node, wherein the method further comprises:
by means of the radio network node, performing a negotiation process when the first and second communications devices have conflicting one or more objectives and updating the respective first and second communications devices' machine learning model based on the result of the negotiation process.

### Claim 4 (depends on 1)

The method of claim 1, wherein the determining of the prediction of the performance of the one network node comprises:
by means of the at least one network node, performing one or more measurements; and
by means of the machine learning unit, using information relating to the performed one or more measurements as input data to the machine learning model in order to determine the prediction of the performance of the one network node, wherein the prediction is based on output data from the machine learning model.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
evaluating the machine learning model after the performing of the one or more operations relating to the one network node based on the determined prediction; and
updating the machine learning model based on the evaluation.

### Claim 6 (depends on 1)

The method of claim 1, wherein the machine learning model is a representation of the at least one network node to which it relates and of the one or more network nodes communicatively connected to the one network node, wherein the machine learning model comprises an input layer, an output layer and one or more hidden layers, wherein each layer comprises one or more artificial neurons linked to one or more other artificial neurons of one of the same layer and of another layer; wherein each artificial neuron has an activation function, an input weighting coefficient, a bias and an output weighting coefficient, and wherein the weighting coefficients and the bias are changeable during training of the machine learning model, wherein the method further comprises:
by means of the machine learning unit, training the machine learning model based on one or more known input data and on one or more known output data relating to a result of an operation of the one network node with the known input data, wherein each one of the one or more known output data corresponds to a respective one of the one or more known input data.

### Claim 7 (depends on 6)

The method of claim 6, wherein the training of the machine learning model comprises:
adjusting weighting coefficients and biases for one or more of the artificial neurons until the known output data is given as an output from the machine learning model when the corresponding known input data is given as an input to the machine learning model.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
by means one of the at least one network node and of another network node comprising the machine learning unit, training the machine learning model by using an input parameter relating to a performance of the at least one network node in order to choose one or more operations relating to the performance of the at least one network node, evaluating the machine learning model after performing the one or more operations relating to the performance of the at least one network node, and updating the machine learning model based on the one or more operations.

### Claim 9 (depends on 8)

The method of claim 8, wherein the training of the machine learning model comprises:
training the machine learning model by using the received input parameter and a state relating to an environment of the at least one network node to choose one or more actions relating to the performance of the at least one network node; and wherein the updating of the machine learning model based on the one or more operations comprises:
updating the machine learning model based on the one or more operations and based on the state relating to the environment of the at least one network node.

### Claim 10

A method performed in a network node for handling of machine learning to improve performance of a wireless communications network operating in a wireless communications system, the wireless communications system comprising a central network node and one or more intermediate network nodes arranged between the central network node and one or more leaf network nodes operating in the wireless communications network, the network node is being any one out of the central network node, the one or more intermediate network nodes, or the one or more leaf network nodes, the network node comprising a machine learning unit, the method comprising:
by means of the machine learning unit and a machine learning model relating to at least one network node out of the one or more intermediate network nodes or the one or more leaf network nodes, determining a prediction of a performance of the at least one network node based on input data relating to the at least one network node;
based on the determined prediction, performing one or more operations relating to the at least one network node; and
transmitting at least one of the determined prediction and information relating to the machine learning model to one or more other network nodes.

### Claim 11 (depends on 10)

The method of claim 10, wherein the network node is a radio network node, wherein the method further comprises:
when a leaf network node being a communications device connects to the radio network node, receiving, from the communications device, information relating to one or more objectives of the communications device;
transmitting, to the communications device, a machine learning model suitable for the communications device's one or more objectives;
transmitting, to the communications device, a request to collect data to be used as input data for training of a machine learning model relating to the communications device;
receiving, from the communications device, the collected data;
based on the received collected data, updating the machine learning model suitable for the communications device's one or more objectives; and
transmitting the updated machine learning model to the communications device.

### Claim 12 (depends on 10)

The method of claim 10, wherein the network node is a radio network node and wherein a respective first and second leaf network node is a respective first and second communications device connected to radio network node, wherein the method further comprises:
performing a negotiation process when the first and second communications devices have conflicting one or more objectives and updating the respective first and second communications devices' machine learning model based on the result of the negotiation process.

### Claim 13 (depends on 10)

The method of claim 10, wherein the determining of the prediction of the performance of the one network node comprises:
obtaining from the at least one network node information relating to one or more performed measurements; and
by means of the machine learning unit, using the information relating to the one or more performed measurements as input data to the machine learning model in order to determine the prediction of the performance of the at least one network node, wherein the prediction is based on output data from the machine learning model.

### Claim 14 (depends on 10)

The method of claim 10, further comprising:
evaluating the machine learning model after the performing of the one or more operations relating to the at least one network node based on the determined prediction; and
possibly updating the machine learning model based on the evaluation.

### Claim 15

(canceled)

### Claim 16

A wireless communications system for handling of machine learning to improve performance of a wireless communications network configured to operate in the wireless communications system, the wireless communications system is being configured to comprise a central network node and one or more intermediate network nodes arranged between the central network node and one or more leaf network nodes configured to operate in the wireless communications network, at least one out of: the central network node, the one or more intermediate network nodes or the one or more leaf network nodes being configured to comprise a machine learning unit, the system being configured to:
by means of the machine learning unit and a machine learning model relating to at least one network node out of the one or more intermediate network nodes or the one or more leaf network nodes, determine a prediction of a performance of the at least one network node based on input data relating to the at least one network node;
based on the determined prediction, perform one or more operations relating to the at least one network node; and
communicate at least one of the determined prediction and information relating to the machine learning model to one or more other network nodes.

### Claim 17 (depends on 16)

The system of claim 16, wherein a leaf network node is a communications device connected to an intermediate network node being a radio network node, wherein the system further is configured to:
by means of the communications device transmit to the radio network node information relating to one or more objectives of the communications device when the communications device connects to the radio network node;
by means of the radio network node transmit to the communications device a machine learning model suitable for the communications device's one or more objectives;
by means of the radio network node, request the communications device to collect data to be used as input data for training of a machine learning model relating to the communications device;
by means of the communications device transmit to the radio network node the collected data; and
by means of the radio network node and based on the collected data, update the machine learning model suitable for the communications device's one or more objectives.

### Claim 18 (depends on 16)

The system of claim 16, wherein a respective first and second leaf network node is a respective first and second communications device connected to an intermediate network node being a radio network node, wherein the system further is configured to:
by means of the radio network node, perform a negotiation process when the first and second communications devices have conflicting one or more objectives and updating the respective first and second communications devices' machine learning model based on the result of the negotiation process.

### Claim at position 19

-24. (canceled)

### Claim 25

A network node for handling of machine learning to improve performance of a wireless communications network configured to operate in a wireless communications system, wherein the wireless communications system being configured to comprise a central network node and one or more intermediate network nodes arranged between the central network node and one or more leaf network nodes configured to operate in the wireless communications network, the network node is being any one out of the central network node, the one or more intermediate network nodes, or the one or more leaf network nodes, the network node comprising a machine learning unit, the network node being configured to:
by means of the machine learning unit and a machine learning model relating to at least one network node out of the one or more intermediate network nodes or the one or more leaf network nodes, determine a prediction of a performance of the at least one network node based on input data relating to the at least one network node;
based on the determined prediction, perform one or more operations relating to the at least one network node; and
communicate at least one of the determined prediction and information relating to the machine learning model to one or more other network nodes.

### Claim 26 (depends on 25)

The network node of claim 25,
wherein the network node is a radio network node, wherein the network node further is configured to:
receive from the communications device, information relating to one or more objectives of the communications device when a leaf network node being a communications device connects to the radio network node;
transmit, to the communications device, a machine learning model suitable for the communications device's one or more objectives;
transmit, to the communications device, a request to collect data to be used as input data for training of a machine learning model relating to the communications device;
receive, from the communications device, the collected data;
based on the received collected data, update the machine learning model suitable for the communications device's one or more objectives; and
transmit the updated machine learning model to the communications device.

### Claim 27 (depends on 25)

The network node of claim 25, wherein the network node is a radio network node and
wherein a respective first and second leaf network node is a respective first and second communications device connected to radio network node, wherein the network node further is configured to:
perform a negotiation process when the first and second communications devices have conflicting one or more objectives and updating the respective first and second communications devices' machine learning model based on the result of the negotiation process.

### Claim at position 23

-32. (canceled)
