Feelings, emotions, and empathy play an important role in many daily activities including verbal and non-verbal communications. Their automatic recognition and interpretation is important in a variety of applications requiring communication skills that are difficult to reproduce in computer-simulated environments, including those involving human-avatar interactions. Our recent work has begun investigating the development of intelligent avatars capable of detecting user (human) emotions to allow for realistic human-avatar interactions within medical-based virtual simulations and serious games. In this paper, we present a system that couples eye tracking and dialogue interpretation to allow for intelligent and realistic human-avatar communication. Although formal testing is required, preliminary results are promising, showing the potential of the system.
Eye tracking and speech driven human-avatar emotion-based communication / Cinieri, Saverio; Kapralos, Bill; Lamberti, Fabrizio; Uribe Quevedo, Alvaro. - STAMPA. - (2020), pp. 1-5. ((Intervento presentato al convegno IEEE 8th International Conference on Serious Games and Applications for Health (SeGAH) tenutosi a Vancouver, Canada nel August 12-14, 2020.
Titolo: | Eye tracking and speech driven human-avatar emotion-based communication |
Autori: | |
Data di pubblicazione: | 2020 |
Abstract: | Feelings, emotions, and empathy play an important role in many daily activities including verbal ...and non-verbal communications. Their automatic recognition and interpretation is important in a variety of applications requiring communication skills that are difficult to reproduce in computer-simulated environments, including those involving human-avatar interactions. Our recent work has begun investigating the development of intelligent avatars capable of detecting user (human) emotions to allow for realistic human-avatar interactions within medical-based virtual simulations and serious games. In this paper, we present a system that couples eye tracking and dialogue interpretation to allow for intelligent and realistic human-avatar communication. Although formal testing is required, preliminary results are promising, showing the potential of the system. |
Appare nelle tipologie: | 4.1 Contributo in Atti di convegno |
File in questo prodotto:
File | Descrizione | Tipologia | Licenza | |
---|---|---|---|---|
09201874.pdf | 2a Post-print versione editoriale / Version of Record | Non Pubblico - Accesso privato/ristretto | Administrator Richiedi una copia | |
segah2020_avatarEmotions.pdf | Post-print author's version | 2. Post-print / Author's Accepted Manuscript | PUBBLICO - Tutti i diritti riservati | Visibile a tuttiVisualizza/Apri |
http://hdl.handle.net/11583/2837181