Conventional schemes for service provisioning in next-generation elastic optical networks (EONs) rely on rule-based policies that suffer from scalability issues and can lead to poor resource utilization efficiency due to the lack of knowledge about the essential characteristics of EONs (e.g., traffic profiles, physical-layer impairments). This article discusses the application of emerging deep reinforcement learning (DRL) techniques in EONs for enabling an autonomic (self-driving) and cognitive networking framework. This new framework achieves self-learning-based service provisioning capabilities by employing DRL agents to learn policies from dynamic network operations. Such capabilities can remarkably reduce the amount of human effort invested in developing effective service provisioning policies for emerging applications, and thus, can facilitate fast network evolutions. Based on the framework, we first present DeepRMSA, a DRL-based routing, modulation, and spectrum assignment (RMSA) agent for EONs. Then, as today's networks are often composed of multiple autonomous systems, we extend the autonomic networking framework to multi-domain EONs by applying multi-agent DRL (where multiple autonomous DRL agents learn through jointly interacting with their environments). Comparisons of the results from numerical simulations show significant advantages of the proposed framework over the existing rule-based heuristic designs.

Building Autonomic Elastic Optical Networks with Deep Reinforcement Learning / Chen, X; Proietti, R; Yoo, S. J. B.. - In: IEEE COMMUNICATIONS MAGAZINE. - ISSN 0163-6804. - STAMPA. - 57:10(2019), pp. 20-26. [10.1109/MCOM.001.1900151]

Building Autonomic Elastic Optical Networks with Deep Reinforcement Learning

Proietti R;
2019

Abstract

Conventional schemes for service provisioning in next-generation elastic optical networks (EONs) rely on rule-based policies that suffer from scalability issues and can lead to poor resource utilization efficiency due to the lack of knowledge about the essential characteristics of EONs (e.g., traffic profiles, physical-layer impairments). This article discusses the application of emerging deep reinforcement learning (DRL) techniques in EONs for enabling an autonomic (self-driving) and cognitive networking framework. This new framework achieves self-learning-based service provisioning capabilities by employing DRL agents to learn policies from dynamic network operations. Such capabilities can remarkably reduce the amount of human effort invested in developing effective service provisioning policies for emerging applications, and thus, can facilitate fast network evolutions. Based on the framework, we first present DeepRMSA, a DRL-based routing, modulation, and spectrum assignment (RMSA) agent for EONs. Then, as today's networks are often composed of multiple autonomous systems, we extend the autonomic networking framework to multi-domain EONs by applying multi-agent DRL (where multiple autonomous DRL agents learn through jointly interacting with their environments). Comparisons of the results from numerical simulations show significant advantages of the proposed framework over the existing rule-based heuristic designs.
File in questo prodotto:
File Dimensione Formato  
Building_Autonomic_Elastic_Optical_Networks_with_Deep_Reinforcement_Learning.pdf

non disponibili

Tipologia: 2a Post-print versione editoriale / Version of Record
Licenza: Non Pubblico - Accesso privato/ristretto
Dimensione 750.47 kB
Formato Adobe PDF
750.47 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/2972255