Operation of sectorized communications from aerospace platforms using reinforcement learning

A system comprising:

• a memory storing policies for a communication network, each policy being a set of features for forming a plurality of communication links in the communication network over a given time interval and being associated with a corresponding utility value, the utility value being a function of a performance metric of the communication network for the given time interval, the plurality of communication links providing one or more paths through the communication network;
• and
• one or more processors capable of accessing the memory, the one or more processors being configured to:
• receive input data related to a state of the communication network and input data related to operation of the communication network for a first time interval;
• determine a first policy for the communication network based on the input data, the first policy being a set of features for forming a plurality of communication links in the communication network over the first time interval, the plurality of communication links providing one or more paths through the communication network;
• determine a utility value associated with the first policy as a function of a performance metric of the communication network in the first time interval;
• determine a second policy for the communication network for a second time interval based at least in part on the utility value associated with the first policy;
• and
• operate the communication network to implement the second policy in the second time interval.

A non-transitory, tangible computer-readable storage medium on which computer readable instructions of a program are stored, the instructions, when executed by one or more processors, cause the one or more processors to perform a method, the method comprising:

• receiving input data related to a state of the communication network and input data related to operation of the communication network for a first time interval;
• determining a first policy for the communication network based on the input data, the first policy being a set of features for forming a plurality of communication links in the communication network over the first time interval, the plurality of communication links providing one or more paths through the communication network;
• determining a utility value associated with the first policy as a function of a performance metric of the communication network in the first time interval;
• determining a second policy for the communication network for a second time interval based at least in part on the utility value associated with the first policy;
• and
• operating the communication network to implement the second policy in the second time interval.