# US 2026/0040308 A1 · Methods for Reward Signal Design and Handling for UE-sided Reinforcement Learning

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0040308 A1
- Document ID: US20260040308A1
- Status: Published application
- Kind: A1
- Application number: 18/790,824
- Filed: 2024-07-31
- Published: 2026-02-05
- Earliest claimed: 2024-07-31
- Assignees: InterDigital Patent Holdings, Inc.
- Applicants: InterDigital Patent Holdings, Inc.
- Inventors: Ahmet Serdar Tan; Yugeswar Deenoo Narayanan Thangaraj; Mohamed Salah Ibrahim; Mihaela Beluri
- Web page: https://patentgrep.com/patent/US20260040308A1

## CPC

- H04B 7/06964: {Re-selection of one or more beams after beam failure}
- H04W 72/20: Control channels or signalling for resource management
- H04L 41/16: using machine learning or artificial intelligence
- H04B: TRANSMISSION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

An example Wireless Transmit/Receive Unit (WTRU) includes a processor. The processor is configured to receive configuration information. The configuration information comprises an indication of an exploration rate for operating according to an exploration mode or an exploitation mode, and an indication of a reward type. The processor is configured to send an indication of a first action associated with the exploitation mode, receive an out-of-range (OOR) indication and an indication of a reward signal associated with the reward type, send a request associated with the exploration mode based on the reward signal being less than a threshold and the OOR indication indicating that an OOR condition is not detected, and adjust one or more actions to be performed by the WTRU based on the reward signal being less than the threshold and the OOR indication indicating that the OOR condition is detected.

## Claims

### Claim 1

A Wireless Transmit/Receive Unit (WTRU) comprising:
a processor configured to:
receive configuration information, wherein the configuration information comprises an indication of an exploration rate for operating according to an exploration mode or an exploitation mode, wherein the configuration information further comprises an indication of a reward type for reward signals;
send an indication of a first action associated with the exploitation mode;
receive an out-of-range (OOR) indication and an indication of a reward signal associated with the reward type;
based on the reward signal being less than a threshold and the OOR indication indicating that an OOR condition is not detected, send a request associated with the exploration mode; and
based on the reward signal being less than the threshold and the OOR indication indicating that the OOR condition is detected, adjust one or more actions to be performed by the WTRU.

### Claim 2 (depends on 1)

The WTRU of claim 1, wherein the reward type is associated with an acknowledgement or negative acknowledgement (ACK/NACK) indication.

### Claim 3 (depends on 1)

The WTRU of claim 1, wherein the reward type is associated with a beam indication.

### Claim 4 (depends on 1)

The WTRU of claim 1, wherein the processor is configured to, in response to a beam failure detection (BFD), delay or prevent a beam failure recovery (BFR) action associated with the BFD to adjust the one or more actions.

### Claim 5 (depends on 1)

The WTRU of claim 1, wherein the processor is configured to, in response to a decoding failure, send an acknowledgement (ACK) indication to adjust the one or more actions.

### Claim 6 (depends on 1)

The WTRU of claim 1, wherein the indication is received via one or more of physical downlink shared channel (PDSCH) configuration information, an acknowledgement or negative acknowledgement (ACK/NACK) indication, a hybrid automatic repeat request (HARQ), or downlink control information (DCI).

### Claim 7

A method performed by a Wireless Transmit/Receive Unit (WTRU), the method comprising:
receiving configuration information, wherein the configuration information comprises an indication of an exploration rate for operating according to an exploration mode or an exploitation mode, wherein the configuration information further comprises an indication of a reward type for reward signals;
sending an indication of a first action associated with the exploitation mode;
receiving an out-of-range (OOR) indication and an indication of a reward signal associated with the reward type; and
based on the reward signal being less than a threshold and the OOR indication indicating that an OOR condition is not detected, sending a request associated with the exploration mode; or
based on the reward signal being less than the threshold and the OOR indication indicating that the OOR condition is detected, adjusting one or more actions to be performed by the WTRU.

### Claim 8 (depends on 7)

The method of claim 7, wherein the reward type is associated with an acknowledgement or negative acknowledgement (ACK/NACK) indication.

### Claim 9 (depends on 7)

The method of claim 7, wherein the reward type is associated with a beam indication.

### Claim 10 (depends on 7)

The method of claim 7, wherein adjusting the one or more actions comprises:
in response to a beam failure detection (BFD), delaying or preventing a beam failure recovery (BFR) action associated with the BFD.

### Claim 11 (depends on 7)

The method of claim 7, wherein adjusting the one or more actions comprises:
in response to a decoding failure, sending an acknowledgement (ACK) indication.

### Claim 12 (depends on 7)

The method of claim 7, wherein the indication is received via one or more of physical downlink shared channel (PDSCH) configuration information, an acknowledgement or negative acknowledgement (ACK/NACK) indication, a hybrid automatic repeat request (HARQ), or downlink control information (DCI).

### Claim 13 (depends on 12)

The method of claim 12, further comprising determining the reward signal based on the received one or more of the PDSCH configuration information, the ACK/NACK indication, the HARQ, or the DCI.

### Claim 14 (depends on 7)

The method of claim 7, wherein the request comprises a request to enter the exploration mode.

### Claim 15 (depends on 7)

The method of claim 7, wherein the request comprises an indication of a second action associated with the exploration mode.

### Claim 16 (depends on 7)

The method of claim 7, wherein sending the indication of the first action comprises sending an indication of one or more channel quality parameters, wherein the one or more channel quality parameters include one or more of a channel quality indicator (CQI) or a rank indicator (RI).

### Claim 17 (depends on 7)

The method of claim 7, wherein sending the indication of the first action comprises sending an indication of one or more beam selection parameters.

### Claim 18 (depends on 7)

The method of claim 7, further comprising activating training of the RL model, wherein sending the indication of the first action is based on the training of the RL model being activated.

### Claim 19 (depends on 18)

The method of claim 18, further comprising receiving an activation command, wherein activating the training of the RL model is in response to receiving the activation command.

### Claim 20 (depends on 18)

The method of claim 18, further comprising:
based on the reward signal being greater than the threshold, determining whether to deactivate training of the RL model.
