# US 2021/0201135 A1 · End-to-end learning in communication systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0201135 A1
- Document ID: US20210201135A1
- Status: Published application
- Kind: A1
- Application number: 17/044,607
- Filed: 2018-04-03
- Published: 2021-07-01
- Earliest claimed: 2018-04-03
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies OY
- Inventors: Jakob HOYDIS; Faycal AIT AOUDIA
- Web page: https://patentgrep.com/patent/US20210201135A1

## CPC

- G06N 3/092: Reinforcement learning
- G06F 18/2413: based on distances to training or reference patterns
- G06F 18/2415: based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
- G06N 3/02: Neural networks
- G06N 3/0499: Feedforward networks
- G06N 3/09: Supervised learning
- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- H04B 1/02: Transmitters
- H04B 1/06: Receivers
- H04L 1/0041: {Arrangements at the transmitter end}
- H04L 1/0045: {Arrangements at the receiver end}
- H04L 25/0204: {of multiple channels}
- H04L 25/0226: {sounding signals per se}
- H04L 25/03114: {non-adaptive, i.e. not adjustable, manually adjustable, or adjustable only during the reception of special signals}
- H04L 25/03165: {using neural networks}
- H04L 25/03343: {Arrangements at the transmitter end}
- G06N 3/08: Learning methods
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04B: TRANSMISSION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

An apparatus and method is described including obtaining or generating a transmitter-training sequence of messages for a transmission system, wherein the transmission system includes a transmitter, a channel and a receiver, wherein the transmitter includes a transmitter algorithm having at least some trainable weights and the receiver includes a receiver algorithm having at least some trainable weights; transmitting perturbed versions of the transmitter-training sequence of messages over the transmission system; receiving first receiver loss function data at the transmitter, the first receiver loss function data being generated based on a received-training sequence as received at the receiver and knowledge of the transmitter training sequence of messages for the transmission system; and training at least some weights of the transmitter algorithm based on first receiver loss function data and knowledge of the transmitter-training sequence of messages and the perturbed versions of the transmitter-training sequence of messages.

## Claims

### Claim 1

An apparatus comprising:
at one processor; and
at least one memory including computer program code;
the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to perform,
obtaining or generating a transmitter-training sequence of messages for a transmission system, wherein the transmission system comprises a transmitter, a channel and a receiver, wherein the transmitter includes a transmitter algorithm having at least some trainable weights and the receiver includes a receiver algorithm having at least some trainable weights;
transmitting perturbed versions of the transmitter-training sequence of messages over the transmission system;
receiving first receiver loss function data at the transmitter, the first receiver loss function data being generated based on a received-training sequence as received at the receiver and knowledge of the transmitter training sequence of messages for the transmission system; and
training at least some weights of the transmitter algorithm based on the first receiver loss function data and knowledge of the transmitter-training sequence of messages and the perturbed versions of the transmitter-training sequence of messages.

### Claim 2 (depends on 1)

An apparatus as claimed in claim 1, wherein the training the at least some weights of the transmitter algorithm makes use of a distribution to generate the perturbations applied to the transmitter-training sequence of messages.

### Claim 3

An apparatus as claimed in claim i wherein the perturbations are zero-mean Gaussian perturbations.

### Claim 4 (depends on 1)

An apparatus as claimed in claim 1, wherein the first loss function data is related to one or more of block error rate, bit error rate and categorical cross-entropy.

### Claim 5 (depends on 1)

An apparatus as claimed in claim 1, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform repeating the training of the at least some weights of the transmitter algorithm until a first condition is reached.

### Claim 6 (depends on 5)

An apparatus as claimed in claim 5, wherein the first condition is a defined number of iterations and/or a defined performance level.

### Claim 7 (depends on 1)

An apparatus as claimed in claim 1, wherein the training further comprises optimising one or more of a batch size of the transmitter-training sequence of messages, a learning rate, and a distribution of the perturbations applied to the perturbed versions of the transmitter-training sequence of messages.

### Claim 8 (depends on 1)

An apparatus as claimed in claim 1, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform obtaining or generating a receiver-training sequence of messages for transmission over the transmission system;
transmitting the receiver-training sequence of messages over the transmission system;
generating or obtaining second receiver loss function data, the second receiver loss function data being generated based on a received-training sequence as received at the receiver and knowledge of the transmitted receiver-training sequence; and
training at least some weights of the receiver algorithm based on the second receiver loss function data.

### Claim 9 (depends on 8)

An apparatus as claimed claim 8, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform repeating the training of the at least some weights of the receiver algorithm until a second condition is reached.

### Claim 10 (depends on 9)

An apparatus as claimed in claim 9, wherein the second condition is a defined number of iterations and/or a defined performance level.

### Claim 11 (depends on 8)

An apparatus as claimed in claim 8, wherein the second loss function is related to one or more of block error rate, bit error rate and categorical cross-entropy.

### Claim 12 (depends on 8)

An apparatus as claimed in claim 8, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform repeating both the training of the at least some weights of the transmitter algorithm and repeating the training of the at least some weights of the transmitter algorithm until a third condition is reached.

### Claim 13 (depends on 1)

An apparatus as claimed in claim 1, wherein said at least some weights of the transmit and receive algorithms are trained using stochastic gradient descent.

### Claim 14

An apparatus comprising:
at least one processor; and
at least one memory including computer program code;
the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to perform,
obtaining or generating a receiver-training sequence of messages for transmission over a transmission system, wherein the transmitter includes a transmitter algorithm having at least some trainable weights and the receiver includes a receiver algorithm having at least some trainable weights;
transmitting the receiver-training sequence of messages over the transmission system;
generating or obtaining second receiver loss function data, the second receiver loss function data being generated based on a receiver-training sequence as received at the receiver and knowledge of the transmitted receiver-training sequence;
training at least some weights of the receiver algorithm based on the second receiver loss function data;
obtaining or generating a transmitter-training sequence of messages for the transmission system;
transmitting perturbed versions of the transmitter-training sequence of messages over the transmission system;
receiving first receiver loss function data at the transmitter, the first receiver loss function data being generated based on a received-training sequence as received at the receiver and knowledge of the transmitter training sequence of messages for the transmission system; and
training at least some weights of the transmitter algorithm based on the first receiver loss function data and knowledge of the transmitter-training sequence of messages and the perturbed versions of the transmitter-training sequence of messages.

### Claim 15 (depends on 14)

An apparatus as claimed in claim 14, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform repeating the training of the at least some weights of the transmitter algorithm until a first condition is reached and means for repeating the training of the at least some weights of the receiver algorithm until a second condition is reached.

### Claim 16 (depends on 15)

An apparatus as claimed in claim 15, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform repeating both the training of the at least some weights of the transmitter algorithm and repeating the training of the at least some weights of the transmitter algorithm until a third condition is reached.

### Claim 17 (depends on 14)

An apparatus as claimed in claim 14, wherein the transmitter algorithm comprises a transmitter neural network and/or the receiver algorithm comprises a receiver neural network.

### Claim 18

A method comprising:
obtaining or generating a transmitter-training sequence of messages for a transmission system, wherein the transmission system comprises a transmitter, a channel and a receiver, wherein the transmitter includes a transmitter algorithm having at least some trainable weights and the receiver includes a receiver algorithm having at least some trainable weights;
transmitting perturbed versions of the transmitter-training sequence of messages over the transmission system;
receiving first receiver loss function data at the transmitter, the first receiver loss function data being generated based on a received-training sequence as received at the receiver and knowledge of the transmitter training sequence of messages for the transmission system; and
training at least some weights of the transmitter algorithm based on first receiver loss function data and knowledge of the transmitter-training sequence of messages and the perturbed versions of the transmitter-training sequence of messages.

### Claim 19 (depends on 18)

A method as claimed in claim 18, further comprising:
obtaining or generating a receiver-training sequence of messages for transmission over the transmission system;
transmitting the receiver-training sequence of messages over the transmission system;
generating or obtaining a second receiver loss function data, the second receiver loss function data being generated based on received-training sequence as received at the receiver and knowledge of the transmitted receiver-training sequence; and
training at least some weights of the receiver algorithm based on the second receiver loss function data.

### Claim 20

A method comprising:
obtaining or generating a receiver-training sequence of messages for transmission over a transmission system, wherein the transmitter includes a transmitter algorithm having at least some trainable weights and the receiver includes a receiver algorithm having at least some trainable weights;
transmitting the receiver-training sequence of messages over the transmission system;
generating or obtaining second receiver loss function data, the second receiver loss function data being generated based on a receiver-training sequence as received at the receiver and knowledge of the transmitted receiver-training sequence;
training at least some weights of the receiver algorithm based on the second loss function;
obtaining or generating a transmitter-training sequence of messages for transmission over the transmission system;
transmitting perturbed versions of the transmitter-training sequence of messages over the transmission system;
receive first receiver loss function data at the transmitter, the first receiver loss function data being generated based on a received-training sequence as received at the receiver and knowledge of the transmitter training sequence of messages for the transmission system; and
training at least some weights of the transmitter algorithm based on the first receiver loss function data and knowledge of the transmitter-training sequence of messages and the perturbed versions of the transmitter-training sequence of messages.

### Claim 21

A non-transitory computer readable medium storing a computer program comprising instructions, which when executed by a processor, cause an apparatus including the processor to perform the following:
obtaining or generating a transmitter-training sequence of messages for a transmission system, wherein the transmission system comprises a transmitter, a channel and a receiver, wherein the transmitter includes a transmitter algorithm and the receiver includes a receiver algorithm;
transmitting perturbed versions of the transmitter-training sequence of messages over the transmission system;
receiving first receiver loss function data at the transmitter, the first receiver loss function data being generated based on a received-training sequence as received at the receiver and knowledge of the transmitter training sequence of messages for the transmission system; and
training at least some weights of the transmitter algorithm based on first receiver loss function data and knowledge of the transmitter-training sequence of messages and the perturbed versions of the transmitter-training sequence of messages.

### Claim 22

A non-transitory computer readable medium storing a computer program comprising instructions, which when executed by a processor, cause an apparatus including the processor to perform the following:
obtaining or generating a receiver-training sequence of messages for transmission over a transmission system, wherein the transmitter includes a transmitter algorithm having at least some trainable weights and the receiver includes a receiver algorithm having at least some trainable weights;
transmitting the receiver-training sequence of messages over the transmission system;
generating or obtaining a second receiver loss function data, the second receiver loss function data being generated based on a receiver-training sequence as received at the receiver and knowledge of the transmitted receiver-training sequence;
training at least some weights of the receiver algorithm based on the second loss function;
obtaining or generating a transmitter-training sequence of messages for transmission over the transmission system;
transmitting perturbed versions of the transmitter-training sequence of messages over the transmission system;
receive first receiver loss function data at the transmitter, the first receiver loss function data being generated based on a received-training sequence as received at the receiver and knowledge of the transmitter training sequence of messages for the transmission system; and
training at least some weights of the transmitter algorithm based on the first receiver loss function data and knowledge of the transmitter-training sequence of messages and the perturbed versions of the transmitter-training sequence of messages.
