Out-of-distribution detection has become an important theme in machine learning (ML) field, since the recognition of unseen data either “similar” or not (in- or out-of-distribution) to the ones the ML system has been trained on may lead to potentially fatal consequences. Operational data compliance with the training data has to be verified by the data analyst, who must also understand, in operation, if the autonomous decision-making is still safe or not. In this paper, we study an out-of-distribution (OoD) detection approach based on a rule-based eXplainable Artificial Intelligence (XAI) model. Specifically, the method relies on an innovative metric, i.e., the weighted mutual information, able to capture the different way decision rules are used in case of in- and OoD data.
Weighted Mutual Information for Out-Of-Distribution Detection / De Bernardi, Giacomo; Narteni, Sara; Cambiaso, Enrico; Muselli, Marco; Mongelli, Maurizio. - 1903:(2023), pp. 318-331. (Intervento presentato al convegno First World Conference on eXplainable Artificial Intelligence (xAI 2023) tenutosi a Lisbon (Portugal) nel 26-28 July 2023) [10.1007/978-3-031-44070-0_16].
Weighted Mutual Information for Out-Of-Distribution Detection
Sara Narteni;
2023
Abstract
Out-of-distribution detection has become an important theme in machine learning (ML) field, since the recognition of unseen data either “similar” or not (in- or out-of-distribution) to the ones the ML system has been trained on may lead to potentially fatal consequences. Operational data compliance with the training data has to be verified by the data analyst, who must also understand, in operation, if the autonomous decision-making is still safe or not. In this paper, we study an out-of-distribution (OoD) detection approach based on a rule-based eXplainable Artificial Intelligence (XAI) model. Specifically, the method relies on an innovative metric, i.e., the weighted mutual information, able to capture the different way decision rules are used in case of in- and OoD data.File | Dimensione | Formato | |
---|---|---|---|
OOD_Detection_Conference.pdf
embargo fino al 21/10/2024
Tipologia:
2. Post-print / Author's Accepted Manuscript
Licenza:
PUBBLICO - Tutti i diritti riservati
Dimensione
1.35 MB
Formato
Adobe PDF
|
1.35 MB | Adobe PDF | Visualizza/Apri Richiedi una copia |
WeightedMI_ODD_published.pdf
non disponibili
Tipologia:
2a Post-print versione editoriale / Version of Record
Licenza:
Non Pubblico - Accesso privato/ristretto
Dimensione
1.4 MB
Formato
Adobe PDF
|
1.4 MB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11583/2983364