# US 2024/0205956 A1 · Dynamic pucch format configuration using machine learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0205956 A1
- Document ID: US20240205956A1
- Status: Published application
- Kind: A1
- Application number: 18/556,478
- Filed: 2021-04-22
- Published: 2024-06-20
- Earliest claimed: 2021-04-22
- Assignees: Telefonaktiebolaget LM Ericsson (publ)
- Applicants: Telefonaktiebolaget LM Ericsson (publ)
- Inventors: Soma Tayamon; Euhanna Ghadimi
- Web page: https://patentgrep.com/patent/US20240205956A1

## CPC

- H04L 1/0079: {Formats for control data (H04L1/16 takes precedence; training sequences H04L25/00 and H04L27/00)}
- H04W 72/542: using measured or perceived quality
- G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- G06N 3/092: Reinforcement learning
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- H04L 1/0006: {by adapting the transmission format}
- H04L 1/0019: {in which mode-switching is based on a statistical approach}
- H04L 5/0048: {Allocation of pilot signals, i.e. of signals known to the receiver (allocation of control signalling H04L5/0053; use of control signalling H04L5/0091)}
- H04L 5/0053: {Allocation of signalling, i.e. of overhead other than pilot signals}
- H04L 5/0094: {Indication of how sub-channels of the path are allocated}
- H04W 24/02: Arrangements for optimising operational condition
- H04W 72/21: in the uplink direction of a wireless link, i.e. towards the network
- H04L 5/0055: {Physical resource allocation for ACK/NACK (for physical mapping arrangements in ARQ protocols H04L1/1861)}
- H04L 5/0057: {Physical resource allocation for CQI}
- H04L 5/0073: {Allocation arrangements that take into account other cell interferences}
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method (900) performed in a radio access network (RAN) (200) for Physical Uplink Control Channel (PUCCH) format configuration of a user equipment (UE) (102) currently being served by a network node (104) in the RAN. The method includes obtaining (902) information, the information comprising at least one of: UE information about the UE currently being served by the network node in the RAN or network information about the RAN currently serving the UE. The method includes processing (904) the obtained information using a machine learning model (300, 400A, 400B, 500). The method includes selecting (906) a PUCCH format configuration from a plurality of PUCCH format configurations based on the processing. The method includes determining (908) whether to initiate a configuration of the UE to the selected PUCCH format configuration.

## Claims

### Claim 1

A method performed in a radio access network (RAN) for Physical Uplink Control Channel (PUCCH) format configuration of a user equipment (UE) currently being served by a network node in the RAN, the method comprising:
obtaining information, the information comprising at least one of: UE information about the UE currently being served by the network node in the RAN or network information about the RAN currently serving the UE;
processing the obtained information using a machine learning model;
selecting a PUCCH format configuration from a plurality of PUCCH format configurations based on the processing; and
determining whether to initiate a configuration of the UE to the selected PUCCH format configuration.

### Claim at position 2

2-3. (canceled)

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
transmitting a message to initiate a configuration of the UE to the selected PUCCH format configuration.

### Claim at position 4

5-6. (canceled)

### Claim 7 (depends on 1)

The method of claim 1, wherein the UE information comprises one or more of:
a reference signal received power (RSRP) measurement for an uplink or downlink reference signal;
information indicating a measurement of signal to interference and noise ratio (SINR);
a signal attenuation measurement between the UE and the network node;
channel quality indicator (CQI) measurement of a communication link between the UE and the network node;
an indication of a timing advance measurement associated to the UE;
a measurement of a time a signal takes to reach the network node from the UE;
a measurement of a round-trip time a signal takes to reach the network node from the UE and from the UE to the network node;
a type of the UE device;
an interference measurement in the uplink or downlink communication link between the UE and network node; and
a measurement related to a location and/or speed of the UE.

### Claim 8 (depends on 1)

The method of claim 1, wherein the network information comprises one or more of:
a network key performance indicator associated to one or more cells of the RAN;
a number of UEs connected to the RAN;
information indicating a type of network traffic, a traffic load, a quality of service, and/or a radio resource utilization in one or more cells of the RAN;
an estimate of interference, signal propagation strength, and/or signal to interference and noise ratio (SINR) of a communication link between the network node and the UE;
a number of neighboring cells or network nodes that can interfere with the UE;
a type of neighboring cells or network nodes;
a type of traffic and/or distribution of traffic in neighboring cells or network nodes;
one or more mobility related parameters; and
information regarding a location and/or speed of the UE.

### Claim 9 (depends on 1)

The method of claim 1, wherein the selecting the PUCCH configuration format comprises:
obtaining an output from the machine learning model, wherein the output indicates the selected PUCCH format configuration.

### Claim 10 (depends on 1)

The method of claim 1, wherein the selecting the PUCCH configuration format comprises:
selecting a PUCCH format randomly from the plurality of PUCCH formats.

### Claim 11

(canceled)

### Claim 12 (depends on 9)

The method of claim 9, wherein the output comprises a prediction for a PUCCH format configuration.

### Claim 13

(canceled)

### Claim 14 (depends on 9)

The method of claim 9, wherein the output comprises a set of predictions of each of the PUCCH formats of the plurality of PUCCH formats.

### Claim 15 (depends on 14)

The method of claim 14, wherein each prediction corresponds to a numeric value and the selecting the PUCCH format comprises:
selecting a PUCCH format corresponding to a prediction having a highest numeric value.

### Claim 16 (depends on 14)

The method of claim 14, wherein the selecting the PUCCH format comprises:
selecting a PUCCH format according to a probability mass function PMF {pi}i=1n,
wherein pi is a prediction for a PUCCH format of the plurality of PUCCH formats {pi}i=1n, wherein pi ∈ [0, 1]) and Σi=1npn=1.

### Claim 17 (depends on 16)

The method of claim 16, wherein the probability mass function is calculated using:
p
i
=
e
θ
⁢
v
i
∑
k
=
1
n
⁢
e
θ
⁢
v
k
wherein θ is a design parameter determining a sensitivity of PMF values to individual predictions vi for a PUCCH format configuration.

### Claim 18

(canceled)

### Claim 19 (depends on 1)

The method of claim 1, further comprising:
obtaining one or more measurements of the UE or a communication channel between the UE and the network node from the UE after the UE has been configured with the selected PUCCH format configuration; and
determining a success or failure of the selected PUCCH format based on the one or more measurements.

### Claim 20 (depends on 19)

The method of claim 19, wherein the one or more measurements comprises one or more of:
a traffic throughput of the communication channel between the UE and the network node;
a buffer-status report (BSR) of the UE;
an amount of physical resource blocks (PRBs) scheduled in one or more cells of the RAN;
a number of physical resources in downlink control channel allocated for uplink scheduling grants; or
a discontinuous transmission (DTX) rate.

### Claim 21 (depends on 19)

The method of claim 19, further comprising:
updating the machine learning model based on the determining the success or failure of the selected PUCCH format or a success or failure of one or more selected PUCCH formats.

### Claim 22

A method performed in a radio access network (RAN) for training a machine learning model to select a Physical Uplink Control Channel (PUCCH) format configuration of a user equipment (UE) currently being served by a network node in the RAN, the method comprising:
obtaining a plurality of training samples, wherein each training sample comprises a selected PUCCH format selection,
input information comprising at least one of: UE information about the UE or network information about the RAN,
a measured key performance indicator (KPI) after configuring the UE with the PUCCH format selection, and
one or more parameters related to an exploration strategy used at a time of selection of the selected PUCCH format selection;
processing the training samples to determine one or more updated values to one or more model parameters of the machine learning model; and
updating the one or more model parameters of the machine learning model with the one or more updated values.

### Claim 23 (depends on 22)

The method of claim 22, further comprising:
applying the machine learning model with the updated one or more model parameters to select a PUCCH format configuration for the UE.

### Claim 24 (depends on 22)

The method of claim 22, wherein the processing comprises performing an optimization according to
v
=
arg
min
w
∑
t
=
1
T
α
t
⁢
ℓ
⁡
(
f
⁡
(
x
t
,
i
t
,
w
)
,
r
t
)
+
g
⁡
(
w
)
where t=1, . . . , T denotes the number of training samples,
rt is the measured KPI,
(ƒ(⋅), r) is a loss function,
ƒ(xt, it, wk) is a prediction function in which xt is the input information associated with a training sample t, it is the PUCCH format selection for training sample t, and w represents the one or more model parameters,
αt is a positive scalar value representing a weight on an individual training sample, and
g(w) is a regularization term.

### Claim 25 (depends on 24)

The method of claim 24, wherein the loss function comprises a squared loss function or a hinge loss in support vector machines.

### Claim 26 (depends on 24)

The method of claim 24, wherein the prediction function represents an estimated state and action value function where xt represents a state feature and it represents a PUCCH format selection model at time interval t.

### Claim 27 (depends on 24)

The method of claim 24, wherein αt is proportional to the inverse of a probability pn in which a PUCCH format i was selected by the network node at sample t.

### Claim 28

A method performed by a user equipment (UE) in a radio access network (RAN) for Physical Uplink Control Channel (PUCCH) format configuration of the UE, the method comprising:
performing a measurement;
determining that the measurement falls outside a predetermined threshold;
transmitting a first message to a network node in the RAN, the first message comprising a measurement report comprising the measurement;
receiving a second message from the network node, the second message comprising a selected PUCCH format based on the measurement report; and
configuring a transmission of a signal to the RAN according to the selected PUCCH format.

### Claim 29

(canceled)

### Claim 30

(canceled)

### Claim 31 (depends on 28)

The method of claim 28, wherein the measurement comprises a difference between two consecutive reference signal received power (RSRP) measurements.

### Claim 32 (depends on 28)

The method of claim 28, wherein the measurement comprises a measure of throughput combined with a buffer status report.

### Claim 33 (depends on 32)

The method of claim 32, wherein the predetermined threshold comprises a first threshold for the measure of throughput and a second threshold for the buffer status report, and the determining comprises one of:
determining that the measure of throughput is below the first threshold and the buffer status report is greater than the second threshold, or
determining that the measure of throughput is greater than the first threshold and the buffer status report is lower than the second threshold.

### Claim 34 (depends on 28)

The method of claim 28, wherein the measurement comprises an indication of congestion.

### Claim at position 33

35-42. (canceled)
