# US 2024/0256898 A1 · Techniques for using relay averaging in federated learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0256898 A1
- Document ID: US20240256898A1
- Status: Published application
- Kind: A1
- Application number: 18/566,014
- Filed: 2021-09-01
- Published: 2024-08-01
- Earliest claimed: 2021-09-01
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Yuwei REN; Huilin XU; June NAMGOONG
- Web page: https://patentgrep.com/patent/US20240256898A1

## CPC

- G06N 3/098: Distributed learning, e.g. federated learning
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- H04W 88/04: adapted for relaying to or from another terminal or user
- H04W 92/18: between terminal devices
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Some aspects described herein relate to receiving, from each of multiple UEs in sidelink communications, a report of a model update for a federated learning model, generating, based on one or more parameters in the report of the model update received from each of the multiple UEs, a converged model update, and transmitting, to an upstream node, the converged model update. Other aspects relate to receiving, from a base station, an indication of a federated learning model, generating, for the federated learning model and based on a local training on the federated learning model, a model update to be applied to the federated learning model, and transmitting, to a relay UE in sidelink communication, a report of the model update.

## Claims

### Claim 1

An apparatus for wireless communication, comprising:
a transceiver;
a memory configured to store instructions; and
one or more processors communicatively coupled with the memory and the transceiver, wherein the one or more processors are configured to execute the instructions to cause the apparatus to:
receive, from each of multiple user equipment (UEs) in sidelink communications, a report of a model update for a federated learning model;
generate, based on one or more parameters in the report of the model update received from each of the multiple UEs, a converged model update; and
transmit, to an upstream node, the converged model update.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the report from a given one of the multiple UEs further includes a hop count indicating a number of hops for which the report is valid.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the one or more processors are further configured to execute the instructions to cause the apparatus to decrement the hop count to determine an updated hop count to include in the converged model update transmitted to the upstream node.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the report from a given one of the multiple UEs further includes a convergence weight, and wherein the one or more processors are further configured to execute the instructions to cause the apparatus to apply the convergence weight to the one or more parameters in the report from the given one of the multiple UEs in generating the converged model update.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the upstream node is a base station, and wherein the one or more processors are configured to execute the instructions to cause the apparatus to transmit the converged model update in a radio resource control (RRC) message.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the converged model update includes at least one of a model index of the federated learning model, one or more averaged parameters generated in generating the converged model update, an identifier of the multiple UEs, or a count of the multiple UEs.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the upstream node is another relay UE.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the one or more parameters in the report of the model update received for a given one of the multiple UEs includes a value of a relative difference between a parameter of a global federated learning model and a corresponding parameter of the model update.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the one or more parameters in the report indicate a quantization bit-width of the value of the relative difference.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein the value of the relative difference corresponds to a whole model of the model update or to a convolution layer of the model update.

### Claim 11

An apparatus for wireless communication, comprising:
a transceiver;
a memory configured to store instructions; and
one or more processors communicatively coupled with the memory and the transceiver, wherein the one or more processors are configured to execute the instructions to cause the apparatus to:
receive, from a base station, an indication of a federated learning model;
generate, for the federated learning model and based on a local training on the federated learning model, a model update to be applied to the federated learning model; and
transmit, to a relay user equipment (UE) in sidelink communication, a report of the model update.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the report of the model update further includes a hop count indicating a number of hops for which the report is valid.

### Claim 13 (depends on 11)

The apparatus of claim 11, wherein the report further includes a convergence weight to apply to the model update.

### Claim 14 (depends on 11)

The apparatus of claim 11, wherein the report further includes a source identifier of the UE and a destination identifier of the relay UE.

### Claim 15 (depends on 11)

The apparatus of claim 11, wherein the report includes a value of a relative difference between a parameter of the federated learning model and a corresponding parameter of the model update.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein one or more parameters in the report indicate a quantization bit-width of the value of the relative difference.

### Claim 17 (depends on 15)

The apparatus of claim 15, wherein the value of the relative difference corresponds to a whole model of the model update or to a convolution layer of the model update.

### Claim 18

A method for wireless communication by a user equipment (UE), comprising:
receiving, from each of multiple UEs in sidelink communications, a report of a model update for a federated learning model;
generating, based on one or more parameters in the report of the model update received from each of the multiple UEs, a converged model update; and
transmitting, to an upstream node, the converged model update.

### Claim 19 (depends on 18)

The method of claim 18, wherein the report from a given one of the multiple UEs further includes a hop count indicating a number of hops for which the report is valid.

### Claim 20 (depends on 19)

The method of claim 19, further comprising decrementing the hop count to determine an updated hop count to include in the converged model update transmitted to the upstream node.

### Claim 21 (depends on 18)

The method of claim 18, wherein the report from a given one of the multiple UEs further includes a convergence weight, and further comprising applying the convergence weight to the one or more parameters in the report from the given one of the multiple UEs in generating the converged model update.

### Claim 22 (depends on 18)

The method of claim 18, wherein the upstream node is a base station, and wherein transmitting the converged model update includes transmitting the converged model update in a radio resource control (RRC) message.

### Claim 23 (depends on 22)

The method of claim 22, wherein the converged model update includes at least one of a model index of the federated learning model, one or more averaged parameters generated in generating the converged model update, an identifier of the multiple UEs, or a count of the multiple UEs.

### Claim 24 (depends on 18)

The method of claim 18, wherein the upstream node is another relay UE.

### Claim 25 (depends on 18)

The method of claim 18, wherein the one or more parameters in the report of the model update received for a given one of the multiple UEs includes a value of a relative difference between a parameter of a global federated learning model and a corresponding parameter of the model update.

### Claim 26 (depends on 25)

The method of claim 25, wherein the one or more parameters in the report indicate a quantization bit-width of the value of the relative difference.

### Claim 27 (depends on 25)

The method of claim 25, wherein the value of the relative difference corresponds to a whole model of the model update or to a convolution layer of the model update.

### Claim 28

A method for wireless communication by a user equipment (UE), comprising:
receiving, from a base station, an indication of a federated learning model;
generating, for the federated learning model and based on a local training on the federated learning model, a model update to be applied to the federated learning model; and
transmitting, to a relay UE in sidelink communication, a report of the model update.

### Claim 29 (depends on 28)

The method of claim 28, wherein the report of the model update further includes a hop count indicating a number of hops for which the report is valid.

### Claim 30 (depends on 28)

The method of claim 28, wherein the report further includes a convergence weight to apply to the model update.
