The reliability of hardware running deep neural networks (DNNs) is becoming the object of multiple research works. Fault injections (FIs) are one of the most used solutions to determine the reliability of DNN models. However, defining how many faults to inject in the model is not a trivial task. An exhaustive FI campaign requires injecting, in modern DNNs, billions or trillions of parameters. On the other hand, random FI campaigns do not offer a practical measure of the accuracy of the result. A different approach is to perform a statistical FI: the number of faults to inject is decided based on the number of possible faults and by fixing an error margin and a confidence level on the measured output metric. While the statistical approach offers the best of both worlds, it requires a proper setup to guarantee its statistically significance. In this work, a study on the statistical fault injection procedure on an image segmentation neural network is proposed. In particular, the study compares results from a random FI campaign and an improperly-defined statistical FI campaign, and shows how they fail at highlighting some of the critical aspects of U-Net, a state-of-the-art DNN used for image segmentation. The proposed approach, by injecting only the 0.07% of all the possible faults, accurately measures both the criticality of each layer and of the parameters' bit with an error margin of 1% and a confidence level of 99%.
A Fast Reliability Analysis of Image Segmentation Neural Networks Exploiting Statistical Fault Injections / Gavarini, G; Ruospo, A; Sanchez, E. - (2023), pp. 1-6. (Intervento presentato al convegno 2023 IEEE 24th Latin American Test Symposium (LATS) tenutosi a Veracruz (Mexico) nel 21-24 March 2023) [10.1109/LATS58125.2023.10154488].
A Fast Reliability Analysis of Image Segmentation Neural Networks Exploiting Statistical Fault Injections
Gavarini, G;Ruospo, A;Sanchez, E
2023
Abstract
The reliability of hardware running deep neural networks (DNNs) is becoming the object of multiple research works. Fault injections (FIs) are one of the most used solutions to determine the reliability of DNN models. However, defining how many faults to inject in the model is not a trivial task. An exhaustive FI campaign requires injecting, in modern DNNs, billions or trillions of parameters. On the other hand, random FI campaigns do not offer a practical measure of the accuracy of the result. A different approach is to perform a statistical FI: the number of faults to inject is decided based on the number of possible faults and by fixing an error margin and a confidence level on the measured output metric. While the statistical approach offers the best of both worlds, it requires a proper setup to guarantee its statistically significance. In this work, a study on the statistical fault injection procedure on an image segmentation neural network is proposed. In particular, the study compares results from a random FI campaign and an improperly-defined statistical FI campaign, and shows how they fail at highlighting some of the critical aspects of U-Net, a state-of-the-art DNN used for image segmentation. The proposed approach, by injecting only the 0.07% of all the possible faults, accurately measures both the criticality of each layer and of the parameters' bit with an error margin of 1% and a confidence level of 99%.File | Dimensione | Formato | |
---|---|---|---|
A_Fast_Reliability_Analysis_of_Image_Segmentation_Neural_Networks_Exploiting_Statistical_Fault_Injections.pdf
non disponibili
Tipologia:
2a Post-print versione editoriale / Version of Record
Licenza:
Non Pubblico - Accesso privato/ristretto
Dimensione
3.68 MB
Formato
Adobe PDF
|
3.68 MB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11583/2982811