Upper limb interactions play an important role in scenarios employing virtual, augmented, and mixed reality. Nu- merous sensors (e.g., optical, magnetic, mechanical, myography), have been employed to provide natural interactions, in some cases requiring additional hardware. Recently, virtual, augmented, and mixed reality headsets have started embedding sensors to avoid the use of external hardware that can be cumbersome, thus increasing their ease of use and setup. Microsoft’s recent approach to embedded sensors is known as inside/out tracking, comprised of integrated cameras that allow interactions through fingers and eye tracking with the Hololens, or controller tracking with the mixed reality headsets. However, the motion capture area of the inside/out sensors is limited to the field of view of the cameras. In this paper, we introduce a custom upper limb motion tracking device that extends the user interactions while employing a VR, AR, or MR headset. Our 3D motion tracking system is a compact wireless wearable prototype employing inertial measurement units that provide orientation and position data that provides upper limb user interaction outside the field of view of the inside/out sensors.
Extending upper limb user interactions in AR, VR and MR headsets employing a custom-made wearable device / Micelli, Luca; Acosta, David; Uribe-Quevedo, Alvaro; Lamberti, Fabrizio; Kapralos, Bill. - STAMPA. - (2018), pp. 1-4. (Intervento presentato al convegno 9th IEEE International Conference on Information, Intelligence, Systems, and Applications (IISA 2018) tenutosi a Zakynthos, Greece nel July 23-25, 2018) [10.1109/IISA.2018.8633693].
Extending upper limb user interactions in AR, VR and MR headsets employing a custom-made wearable device
Fabrizio Lamberti;
2018
Abstract
Upper limb interactions play an important role in scenarios employing virtual, augmented, and mixed reality. Nu- merous sensors (e.g., optical, magnetic, mechanical, myography), have been employed to provide natural interactions, in some cases requiring additional hardware. Recently, virtual, augmented, and mixed reality headsets have started embedding sensors to avoid the use of external hardware that can be cumbersome, thus increasing their ease of use and setup. Microsoft’s recent approach to embedded sensors is known as inside/out tracking, comprised of integrated cameras that allow interactions through fingers and eye tracking with the Hololens, or controller tracking with the mixed reality headsets. However, the motion capture area of the inside/out sensors is limited to the field of view of the cameras. In this paper, we introduce a custom upper limb motion tracking device that extends the user interactions while employing a VR, AR, or MR headset. Our 3D motion tracking system is a compact wireless wearable prototype employing inertial measurement units that provide orientation and position data that provides upper limb user interaction outside the field of view of the inside/out sensors.Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11583/2709862
Attenzione
Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo