Out-of-distribution detection has become an important theme in machine learning (ML) field, since the recognition of unseen data either “similar” or not (in- or out-of-distribution) to the ones the ML system has been trained on may lead to potentially fatal consequences. Operational data compliance with the training data has to be verified by the data analyst, who must also understand, in operation, if the autonomous decision-making is still safe or not. In this paper, we study an out-of-distribution (OoD) detection approach based on a rule-based eXplainable Artificial Intelligence (XAI) model. Specifically, the method relies on an innovative metric, i.e., the weighted mutual information, able to capture the different way decision rules are used in case of in- and OoD data.

Weighted Mutual Information for Out-Of-Distribution Detection / De Bernardi, Giacomo; Narteni, Sara; Cambiaso, Enrico; Muselli, Marco; Mongelli, Maurizio. - 1903:(2023), pp. 318-331. (Intervento presentato al convegno First World Conference on eXplainable Artificial Intelligence (xAI 2023) tenutosi a Lisbon (Portugal) nel 26-28 July 2023) [10.1007/978-3-031-44070-0_16].

Weighted Mutual Information for Out-Of-Distribution Detection

Sara Narteni;
2023

Abstract

Out-of-distribution detection has become an important theme in machine learning (ML) field, since the recognition of unseen data either “similar” or not (in- or out-of-distribution) to the ones the ML system has been trained on may lead to potentially fatal consequences. Operational data compliance with the training data has to be verified by the data analyst, who must also understand, in operation, if the autonomous decision-making is still safe or not. In this paper, we study an out-of-distribution (OoD) detection approach based on a rule-based eXplainable Artificial Intelligence (XAI) model. Specifically, the method relies on an innovative metric, i.e., the weighted mutual information, able to capture the different way decision rules are used in case of in- and OoD data.
2023
978-3-031-44069-4
978-3-031-44070-0
File in questo prodotto:
File Dimensione Formato  
OOD_Detection_Conference.pdf

embargo fino al 21/10/2024

Tipologia: 2. Post-print / Author's Accepted Manuscript
Licenza: PUBBLICO - Tutti i diritti riservati
Dimensione 1.35 MB
Formato Adobe PDF
1.35 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
WeightedMI_ODD_published.pdf

non disponibili

Tipologia: 2a Post-print versione editoriale / Version of Record
Licenza: Non Pubblico - Accesso privato/ristretto
Dimensione 1.4 MB
Formato Adobe PDF
1.4 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/2983364