This paper presents a fast approach for marker-less Full-DOF hand tracking, leveraging only depth information from a single depth camera. This system can be useful in many applications, ranging from tele-presence to remote control of robotic actuators or interaction with 3D virtual environment. We applied the proposed technology to enable remote transmission of signs from Tactile Sing Languages (i.e., Sign Languages with Tactile feedbacks), allowing non-invasive remote communication not only among deaf-blind users, but also with deaf, blind and hearing with prociency in Sign Languages. We show that our approach paves the way to a uid and natural remote communication for deaf-blind people, up to now impossible. This system is a rst prototype for the PARLOMA project, which aims at designing a remote communication system for deaf-blind people.

Real-time single camera hand gesture recognition system for remote deaf-blind communication / AIRO' FARULLA, Giuseppe; Russo, LUDOVICO ORLANDO; Chiara, Pintor; Daniele, Pianu; Giorgio, Micotti; Alice Rita, Salgarella; Domenico, Camboni; Marco, Controzzi; Christian, Cipriani; Calogero Maria, Oddo; Rosa, Stefano; Indaco, Marco. - STAMPA. - 1:(2014), pp. 35-52. (Intervento presentato al convegno 1st International Conference on Augmented and Virtual Reality - Salento AVR 2014 tenutosi a Lecce nel 17-20 September 2014) [10.1007/978-3-319-13969-2_3].

Real-time single camera hand gesture recognition system for remote deaf-blind communication

AIRO' FARULLA, GIUSEPPE;RUSSO, LUDOVICO ORLANDO;ROSA, STEFANO;INDACO, MARCO
2014

Abstract

This paper presents a fast approach for marker-less Full-DOF hand tracking, leveraging only depth information from a single depth camera. This system can be useful in many applications, ranging from tele-presence to remote control of robotic actuators or interaction with 3D virtual environment. We applied the proposed technology to enable remote transmission of signs from Tactile Sing Languages (i.e., Sign Languages with Tactile feedbacks), allowing non-invasive remote communication not only among deaf-blind users, but also with deaf, blind and hearing with prociency in Sign Languages. We show that our approach paves the way to a uid and natural remote communication for deaf-blind people, up to now impossible. This system is a rst prototype for the PARLOMA project, which aims at designing a remote communication system for deaf-blind people.
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/2572146
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo