# US 2022/0012637 A1 · Federated teacher-student machine learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0012637 A1
- Document ID: US20220012637A1
- Status: Published application
- Kind: A1
- Application number: 17/370,462
- Filed: 2021-07-08
- Published: 2022-01-13
- Earliest claimed: 2020-07-09
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies Oy
- Inventors: Hamed REZAZADEGAN TAVAKOLI; Francesco CRICRI; Emre Baris AKSU
- Web page: https://patentgrep.com/patent/US20220012637A1

## CPC

- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N 20/00: Machine learning
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06N 3/09: Supervised learning
- G06N 3/094: Adversarial learning
- G06N 3/096: Transfer learning
- G06N 3/098: Distributed learning, e.g. federated learning
- G06N 20/10: using kernel methods, e.g. support vector machines [SVM]
- G06N 3/047: Probabilistic or stochastic networks
- G06N 3/08: Learning methods
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A node for a federated machine learning system that comprises the node and one or more other nodes configured for the same machine learning task, the node comprising: a federated student machine learning network configured to update a machine learning model in dependence upon updated machine learning models of the one or more node; a teacher machine learning network; means for receiving unlabeled data; means for teaching, using supervised learning, at least the federated first machine learning network using the teacher machine learning network, wherein the teacher machine learning network is configured to receive the data and produce pseudo labels for supervised learning using the data and wherein the federated student machine learning network is configured to perform supervised learning in dependence upon the same received data and the pseudo-labels.

## Claims

### Claim 1

An apparatus for a federated machine learning system that comprises:
at least one processor; and at least one memory including computer program code; the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to perform;
update a machine learning model, with a federated student machine learning network, in dependence upon updated machine learning models of one or more other nodes;
wherein the apparatus is configured for a same machine learning task than the one or more other nodes;
teach, with a teacher machine learning network, by supervised learning, the federated student machine learning network,
wherein the teacher machine learning network is configured to produce pseudo-labels for the supervised learning by using received unlabeled data, and
wherein the federated student machine learning network is configured to perform supervised learning in dependence upon the received unlabeled data and the produced pseudo-labels.

### Claim 2 (depends on 1)

An apparatus as claimed in claim 1, further comprising an adversarial machine learning network that is configured to cause to:
receive the unlabeled data,
receive the produced pseudo-labels from the teacher machine learning network,
receive label-estimates from the federated student machine learning network, and provide an adversarial loss to the teacher machine learning network, for training the teacher machine learning network.

### Claim 3 (depends on 1)

An apparatus as claimed in claim 1, further comprising an adversarial machine learning network that is configured to cause to:
receive the unlabeled data,
receive the produced pseudo-labels from the teacher machine learning network,
receive label-estimates from the federated student machine learning network, and provide an adversarial loss to the federated student machine learning network for training the federated student machine learning network.

### Claim 4 (depends on 1)

An apparatus as claimed in claim 1, further comprising an adversarial machine learning network that is configured to cause to:
receive the unlabeled data,
receive the produced pseudo-labels from the teacher machine learning network,
receive label-estimates from the federated student machine learning network, and provide an adversarial loss to the teacher machine learning network and the federated student machine learning network for training substantially simultaneously and/or parallelly the federated student machine learning network and the teacher machine learning network.

### Claim 5 (depends on 1)

An apparatus as claimed in claim 1,
wherein the supervised learning in dependence upon the received unlabeled data and the produced pseudo-labels further comprises supervised learning of the federated student machine learning network and, as an auxiliary task, unsupervised learning of the teacher machine learning network.

### Claim 6 (depends on 1)

An apparatus as claimed in claim 1, further configured to cause to cluster by unsupervised learning of the teacher machine learning network so that intra-cluster mean distance is minimized and inter-cluster mean distance is maximized.

### Claim 7 (depends on 1)

An apparatus as claimed in claim 1, wherein the teacher machine learning network is further configured to cause to cluster the received unlabeled data and the produced pseudo-labels so that intra-cluster mean distance is minimized and inter-cluster mean distance is maximized.

### Claim 8 (depends on 1)

An apparatus as claimed in claim 1, wherein the federated student machine learning network is configured to update a student machine learning model of the federated student machine learning network in dependence upon updated one or more same first machine learning models of the one or more other nodes.

### Claim 9 (depends on 1)

An apparatus as claimed in claim 1, wherein model parameters of the federated student machine learning network are used to update model parameters of one or more another student machine learning networks.

### Claim 10 (depends on 1)

An apparatus as claimed in claim 1, wherein the federated student machine learning network is a student network and the teacher machine learning network is a teacher network configured to teach the student network.

### Claim 11 (depends on 1)

An apparatus as claimed in claim 1, wherein the apparatus is a central node for the federated machine learning system,
wherein the one or more other node(s) are edge node(s) for the federated machine learning system, and wherein the federated machine learning system has a centralized federated machine learning system.

### Claim 12

A method for a federated machine learning system, comprising:
in a node, updating a machine learning model, with a federated student machine learning network, in dependence upon updated machine learning models of one or more other nodes;
wherein the node is configured for a same machine learning task than the one or more other nodes;
teaching, with a teacher machine learning network, by using supervised learning, the federated student machine learning network,
wherein the teacher machine learning network is configured to produce pseudo-labels for the supervised learning by using received unlabeled data, and
wherein the federated student machine learning network is configured to perform supervised learning in dependence upon the received unlabeled data and the produced pseudo-labels.

### Claim 13 (depends on 12)

A method as claimed in claim 12, further comprising an adversarial machine learning network that is configured for:
receiving the unlabeled data,
receiving the produced pseudo-labels from the teacher machine learning network,
receiving label-estimates from the federated student machine learning network, and providing an adversarial loss to the teacher machine learning network for training the teacher machine learning network.

### Claim 14 (depends on 12)

A method as claimed in claim 12, further comprising an adversarial machine learning network that is configured for:
receiving the unlabeled data,
receiving the produced pseudo-labels from the teacher machine learning network,
receiving label-estimates from the federated student machine learning network, and providing an adversarial loss to the federated student machine learning network for training the federated student machine learning network.

### Claim 15 (depends on 12)

A method as claimed in claim 12, further comprising an adversarial machine learning network that is configured for:
receiving the unlabeled data,
receiving the produced pseudo-labels from the teacher machine learning network,
receiving label-estimates from the federated student machine learning network, and providing an adversarial loss to the teacher machine learning network and the federated student machine learning network for training substantially simultaneously and/or parallelly the federated student machine learning network and the teacher machine learning network.

### Claim 16 (depends on 12)

A method as claimed in claim 12,
wherein the supervised learning in dependence upon the received unlabeled data and the produced pseudo-labels further comprises supervised learning of the federated student machine learning network and, as an auxiliary task, unsupervised learning of the teacher machine learning network.

### Claim 17 (depends on 12)

A method as claimed in claim 12, further configured for clustering by unsupervised learning of the teacher machine learning network so that intra-cluster mean distance is minimized and inter-cluster mean distance is maximized.

### Claim 18

A method as claimed in 12, wherein the teacher machine learning network is further configured for clustering the received unlabeled data and the produced pseudo-labels so that intra-cluster mean distance is minimized and inter-cluster mean distance is maximized.

### Claim 19 (depends on 12)

A method as claimed in claim 12, wherein the federated student machine learning network is configured for updating a student machine learning model of the federated student machine learning network in dependence upon updated one or more same first machine learning models of the one or more other nodes.

### Claim 20

An apparatus for a federated machine learning system configured to a teacher-student machine learning mode, comprising;
at least one processor; and
at least one memory including computer program code;
the at least one memory and the computer program code configured to, with the at least one processor, cause at least to perform:
train, by supervised learning, a federated student machine learning network by use of a teacher machine learning network,
wherein the teacher machine learning network is configured to produce pseudo labels for the supervised learning by use of received unlabeled data,
wherein the federated student machine learning network is configured to perform supervised learning in dependence upon the received unlabeled data and the produced pseudo-labels,
send the trained federated student machine learning network to one or more client nodes,
receive one or more updated client student machine learning models from one or more client nodes for the sent trained federated student machine learning network, and
update the federated student machine learning network with the one or more updated client student machine learning models.
