Quality of Transmission (QoT) classification is a critical task in optical networks, often managed via Machine Learning (ML) models. Traditional ML models may exhibit unintended bias toward certain system parameters. In this paper, we explore multiple strategies to mitigate bias toward modulation formats in a large-scale QoT dataset containing more than 1.3 million samples and 32 features. We systematically proposed a hybrid approach that combines three techniques: (i) preprocessing, (ii) in-processing, and (iii) post-processing.We employ XGBoost as our baseline classifier and measure performance using accuracy, ROC-AUC, precision, and recall, along with fairness metrics such as Demographic Parity Difference, Equalized Odds Difference, and Predictive Value Parity. Our results demonstrate that hybrid solutions substantially reduce bias while preserving competitive model performance. These findings highlight the feasibility of combining complementary fairness approaches to achieve fair QoT predictions without a significant loss in classification accuracy. We discuss practical considerations for deploying such techniques in real-world systems and outline directions for future work, including extended subgroup analysis and alternative pre-processing methods.
Enhancing Reliability of Lightpath QoT Estimation Models using Bias Mitigation Techniques / Jammal, Hussein; Ayoub, Omran; Bianco, Andrea; Owayjan, Michel; Rottondi, Cristina. - ELETTRONICO. - (2025), pp. 1-4. (Intervento presentato al convegno 25th Anniversary International Conference on Transparent Optical Networks (ICTON) tenutosi a Barcelona (Spa) nel 06-10 July 2025) [10.1109/icton67126.2025.11125252].
Enhancing Reliability of Lightpath QoT Estimation Models using Bias Mitigation Techniques
Jammal, Hussein;Bianco, Andrea;Rottondi, Cristina
2025
Abstract
Quality of Transmission (QoT) classification is a critical task in optical networks, often managed via Machine Learning (ML) models. Traditional ML models may exhibit unintended bias toward certain system parameters. In this paper, we explore multiple strategies to mitigate bias toward modulation formats in a large-scale QoT dataset containing more than 1.3 million samples and 32 features. We systematically proposed a hybrid approach that combines three techniques: (i) preprocessing, (ii) in-processing, and (iii) post-processing.We employ XGBoost as our baseline classifier and measure performance using accuracy, ROC-AUC, precision, and recall, along with fairness metrics such as Demographic Parity Difference, Equalized Odds Difference, and Predictive Value Parity. Our results demonstrate that hybrid solutions substantially reduce bias while preserving competitive model performance. These findings highlight the feasibility of combining complementary fairness approaches to achieve fair QoT predictions without a significant loss in classification accuracy. We discuss practical considerations for deploying such techniques in real-world systems and outline directions for future work, including extended subgroup analysis and alternative pre-processing methods.File | Dimensione | Formato | |
---|---|---|---|
ICTON_2025 (3).pdf
accesso aperto
Descrizione: manuscript
Tipologia:
2. Post-print / Author's Accepted Manuscript
Licenza:
Pubblico - Tutti i diritti riservati
Dimensione
765.39 kB
Formato
Adobe PDF
|
765.39 kB | Adobe PDF | Visualizza/Apri |
Enhancing_Reliability_of_Lightpath_QoT_Estimation_Models_using_Bias_Mitigation_Techniques.pdf
accesso riservato
Tipologia:
2a Post-print versione editoriale / Version of Record
Licenza:
Non Pubblico - Accesso privato/ristretto
Dimensione
820.64 kB
Formato
Adobe PDF
|
820.64 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11583/3002880