The high bandwidth and low latency requirements of modern computing applications with their dynamic and nonuniform traffic patterns impose severe challenges to current data center (DC) and high performance computing (HPC) networks. Therefore, we present a dynamic network reconfiguration mechanism that could satisfy the time-varying applications' demands in an optical DC/HPC network. We propose a direct and an indirect topology extraction methods based on a machine learning-Aided traffic prediction approach under multi-Application scenario. The traffic prediction for topology extraction and bandwidth reconfiguration (PredicTER) method could lead to frequent topology and bandwidth reconfiguration. In contrast, the indirect approach, namely traffic prediction with clustering for topology extraction and bandwidth reconfiguration (PrediCLUSTER), utilizes an unsupervised learning-based clustering model to first associate the predicted traffic to one of possible traffic clusters, and then extracts a common topology for the cluster. This restricts the reconfigured topology set to the number of traffic clusters. Our simulation results show that the time-Average of mean packet latencies (and total dropped packets) over 60 seconds of timevarying traffic under the PredicTER, PrediCLUSTER and a static topology are 37.7μs,41.2μs, and 50.2μs (and 37,967, 12,305, and 36,836), respectively. Overall, the PredicTER (and PrediCLUSTER) method(s) can improve the end-To-end packet latency by 24.9% (and 17.8%), and the packet loss rate by-3.1% (and 66.6%), as compared to the static flat Hyper-X-like topology.

Machine-Learning-Aided Dynamic Reconfiguration in Optical DC/HPC Networks (Invited) / Singh, S. K.; Liu, C. -Y.; Ben Yoo, S. J.; Proietti, R.. - ELETTRONICO. - (2022), pp. 1-6. (Intervento presentato al convegno 2022 International Conference on Optical Network Design and Modeling, ONDM 2022 tenutosi a Warsaw, Poland nel 16-19 May 2022) [10.23919/ONDM54585.2022.9782838].

Machine-Learning-Aided Dynamic Reconfiguration in Optical DC/HPC Networks (Invited)

Proietti R.
2022

Abstract

The high bandwidth and low latency requirements of modern computing applications with their dynamic and nonuniform traffic patterns impose severe challenges to current data center (DC) and high performance computing (HPC) networks. Therefore, we present a dynamic network reconfiguration mechanism that could satisfy the time-varying applications' demands in an optical DC/HPC network. We propose a direct and an indirect topology extraction methods based on a machine learning-Aided traffic prediction approach under multi-Application scenario. The traffic prediction for topology extraction and bandwidth reconfiguration (PredicTER) method could lead to frequent topology and bandwidth reconfiguration. In contrast, the indirect approach, namely traffic prediction with clustering for topology extraction and bandwidth reconfiguration (PrediCLUSTER), utilizes an unsupervised learning-based clustering model to first associate the predicted traffic to one of possible traffic clusters, and then extracts a common topology for the cluster. This restricts the reconfigured topology set to the number of traffic clusters. Our simulation results show that the time-Average of mean packet latencies (and total dropped packets) over 60 seconds of timevarying traffic under the PredicTER, PrediCLUSTER and a static topology are 37.7μs,41.2μs, and 50.2μs (and 37,967, 12,305, and 36,836), respectively. Overall, the PredicTER (and PrediCLUSTER) method(s) can improve the end-To-end packet latency by 24.9% (and 17.8%), and the packet loss rate by-3.1% (and 66.6%), as compared to the static flat Hyper-X-like topology.
2022
978-3-903176-44-7
File in questo prodotto:
File Dimensione Formato  
ONDM_2022_Invited (3).pdf

accesso aperto

Tipologia: 2. Post-print / Author's Accepted Manuscript
Licenza: PUBBLICO - Tutti i diritti riservati
Dimensione 1.1 MB
Formato Adobe PDF
1.1 MB Adobe PDF Visualizza/Apri
Machine-Learning-Aided_Dynamic_Reconfiguration_in_Optical_DC_HPC_Networks_Invited.pdf

non disponibili

Tipologia: 2a Post-print versione editoriale / Version of Record
Licenza: Non Pubblico - Accesso privato/ristretto
Dimensione 1.02 MB
Formato Adobe PDF
1.02 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/2972983