Conventional schemes for service provisioning in next-generation elastic optical networks (EONs) rely on rule-based policies that suffer from scalability issues and can lead to poor resource utilization efficiency due to the lack of knowledge about the essential characteristics of EONs (e.g., traffic profiles, physical-layer impairments). This article discusses the application of emerging deep reinforcement learning (DRL) techniques in EONs for enabling an autonomic (self-driving) and cognitive networking framework. This new framework achieves self-learning-based service provisioning capabilities by employing DRL agents to learn policies from dynamic network operations. Such capabilities can remarkably reduce the amount of human effort invested in developing effective service provisioning policies for emerging applications, and thus, can facilitate fast network evolutions. Based on the framework, we first present DeepRMSA, a DRL-based routing, modulation, and spectrum assignment (RMSA) agent for EONs. Then, as today's networks are often composed of multiple autonomous systems, we extend the autonomic networking framework to multi-domain EONs by applying multi-agent DRL (where multiple autonomous DRL agents learn through jointly interacting with their environments). Comparisons of the results from numerical simulations show significant advantages of the proposed framework over the existing rule-based heuristic designs.
Building Autonomic Elastic Optical Networks with Deep Reinforcement Learning / Chen, X; Proietti, R; Yoo, S. J. B.. - In: IEEE COMMUNICATIONS MAGAZINE. - ISSN 0163-6804. - STAMPA. - 57:10(2019), pp. 20-26. [10.1109/MCOM.001.1900151]
Building Autonomic Elastic Optical Networks with Deep Reinforcement Learning
Proietti R;
2019
Abstract
Conventional schemes for service provisioning in next-generation elastic optical networks (EONs) rely on rule-based policies that suffer from scalability issues and can lead to poor resource utilization efficiency due to the lack of knowledge about the essential characteristics of EONs (e.g., traffic profiles, physical-layer impairments). This article discusses the application of emerging deep reinforcement learning (DRL) techniques in EONs for enabling an autonomic (self-driving) and cognitive networking framework. This new framework achieves self-learning-based service provisioning capabilities by employing DRL agents to learn policies from dynamic network operations. Such capabilities can remarkably reduce the amount of human effort invested in developing effective service provisioning policies for emerging applications, and thus, can facilitate fast network evolutions. Based on the framework, we first present DeepRMSA, a DRL-based routing, modulation, and spectrum assignment (RMSA) agent for EONs. Then, as today's networks are often composed of multiple autonomous systems, we extend the autonomic networking framework to multi-domain EONs by applying multi-agent DRL (where multiple autonomous DRL agents learn through jointly interacting with their environments). Comparisons of the results from numerical simulations show significant advantages of the proposed framework over the existing rule-based heuristic designs.File | Dimensione | Formato | |
---|---|---|---|
Building_Autonomic_Elastic_Optical_Networks_with_Deep_Reinforcement_Learning.pdf
non disponibili
Tipologia:
2a Post-print versione editoriale / Version of Record
Licenza:
Non Pubblico - Accesso privato/ristretto
Dimensione
750.47 kB
Formato
Adobe PDF
|
750.47 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11583/2972255