Creating a global reinforcement learning (RL) model from subnetwork RL agents
AssigneeCiena Corporation
InventorsChristopher Barber, Sa'di Altamimi, Shervin Shirmohammadi, David Côté
Life of this patent
Estimating the term…
Loading patent…
AssigneeCiena Corporation
InventorsChristopher Barber, Sa'di Altamimi, Shervin Shirmohammadi, David Côté
Estimating the term…
Methods are provided for recommending actions to improve operability of a network. In one implementation, a method includes acknowledging a plurality of subnetworks in a whole network, each subnetwork including multiple nodes and being represented by a tunnel group having multiple end-to-end tunnels through the subnetwork. The method also includes selecting a first group of subnetworks from the plurality of subnetworks and generating a Reinforcement Learning (RL) agent for each subnetwork of the first group. Each RL agent is based on observations of end-to-end metrics of the end-to-end tunnels of the respective subnetwork. The observations are independent of specific topology information of the subnetwork. Also, the method includes training a global model based on the RL agents of the first group of subnetworks and applying the global model to an Action Recommendation Engine (ARE) configured for recommending actions that can be taken to improve a state of the whole network.
A non-transitory computer-readable medium configured to store computer logic having instructions that, when executed, enable a processing device to perform the steps of:
A non-transitory computer-readable medium configured to store computer logic having instructions that, when executed, enable a processing device to:
Dependencies are inferred from the claim text.