In this study, we present SCHuBERT, a real-time end-to-end Piano Music Emotion Recognition (PMER) system that operates directly on raw audio and fine-tunes DistilHuBERT for short-window classification on the Valence–Arousal plane. Designed for low latency and high responsiveness, the system is particularly well suited for immersive applications such as virtual and augmented reality. Compared with both audio- and symbolic-domain baselines, SCHuBERT achieves strong accuracy in four-quadrant classification as well as in binary arousal and valence tasks, while maintaining low computational overhead for real-time operation.

SCHuBERT: A Real-Time End-to-End Model for Piano Music Emotion Recognition / Zanoni, M., Rossi, R., Sironi, A., Belluco, P., Rottondi, C.. - ELETTRONICO. - (2026). (6th International Conference on Audio for Virtual and Augmented Reality and Immersive Games Parigi (FR) 30 giugno-3 luglio 2026).

SCHuBERT: A Real-Time End-to-End Model for Piano Music Emotion Recognition.

M. Zanoni;C. Rottondi
2026

Abstract

In this study, we present SCHuBERT, a real-time end-to-end Piano Music Emotion Recognition (PMER) system that operates directly on raw audio and fine-tunes DistilHuBERT for short-window classification on the Valence–Arousal plane. Designed for low latency and high responsiveness, the system is particularly well suited for immersive applications such as virtual and augmented reality. Compared with both audio- and symbolic-domain baselines, SCHuBERT achieves strong accuracy in four-quadrant classification as well as in binary arousal and valence tasks, while maintaining low computational overhead for real-time operation.
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/3017042
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo