Quality of Transmission (QoT) classification is a critical task in optical networks, often managed via Machine Learning (ML) models. Traditional ML models may exhibit unintended bias toward certain system parameters. In this paper, we explore multiple strategies to mitigate bias toward modulation formats in a large-scale QoT dataset containing more than 1.3 million samples and 32 features. We systematically proposed a hybrid approach that combines three techniques: (i) preprocessing, (ii) in-processing, and (iii) post-processing.We employ XGBoost as our baseline classifier and measure performance using accuracy, ROC-AUC, precision, and recall, along with fairness metrics such as Demographic Parity Difference, Equalized Odds Difference, and Predictive Value Parity. Our results demonstrate that hybrid solutions substantially reduce bias while preserving competitive model performance. These findings highlight the feasibility of combining complementary fairness approaches to achieve fair QoT predictions without a significant loss in classification accuracy. We discuss practical considerations for deploying such techniques in real-world systems and outline directions for future work, including extended subgroup analysis and alternative pre-processing methods.

Enhancing Reliability of Lightpath QoT Estimation Models using Bias Mitigation Techniques / Jammal, Hussein; Ayoub, Omran; Bianco, Andrea; Owayjan, Michel; Rottondi, Cristina. - ELETTRONICO. - (2025), pp. 1-4. (Intervento presentato al convegno 25th Anniversary International Conference on Transparent Optical Networks (ICTON) tenutosi a Barcelona (Spa) nel 06-10 July 2025) [10.1109/icton67126.2025.11125252].

Enhancing Reliability of Lightpath QoT Estimation Models using Bias Mitigation Techniques

Jammal, Hussein;Bianco, Andrea;Rottondi, Cristina
2025

Abstract

Quality of Transmission (QoT) classification is a critical task in optical networks, often managed via Machine Learning (ML) models. Traditional ML models may exhibit unintended bias toward certain system parameters. In this paper, we explore multiple strategies to mitigate bias toward modulation formats in a large-scale QoT dataset containing more than 1.3 million samples and 32 features. We systematically proposed a hybrid approach that combines three techniques: (i) preprocessing, (ii) in-processing, and (iii) post-processing.We employ XGBoost as our baseline classifier and measure performance using accuracy, ROC-AUC, precision, and recall, along with fairness metrics such as Demographic Parity Difference, Equalized Odds Difference, and Predictive Value Parity. Our results demonstrate that hybrid solutions substantially reduce bias while preserving competitive model performance. These findings highlight the feasibility of combining complementary fairness approaches to achieve fair QoT predictions without a significant loss in classification accuracy. We discuss practical considerations for deploying such techniques in real-world systems and outline directions for future work, including extended subgroup analysis and alternative pre-processing methods.
2025
979-8-3315-9777-1
File in questo prodotto:
File Dimensione Formato  
ICTON_2025 (3).pdf

accesso aperto

Descrizione: manuscript
Tipologia: 2. Post-print / Author's Accepted Manuscript
Licenza: Pubblico - Tutti i diritti riservati
Dimensione 765.39 kB
Formato Adobe PDF
765.39 kB Adobe PDF Visualizza/Apri
Enhancing_Reliability_of_Lightpath_QoT_Estimation_Models_using_Bias_Mitigation_Techniques.pdf

accesso riservato

Tipologia: 2a Post-print versione editoriale / Version of Record
Licenza: Non Pubblico - Accesso privato/ristretto
Dimensione 820.64 kB
Formato Adobe PDF
820.64 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/3002880