PORTO @ 
Archivio Istituzionale della Ricerca
IRIS è la soluzione IT che facilita la raccolta e la gestione dei dati relativi alle attività e ai prodotti della ricerca. Fornisce a ricercatori, amministratori e valutatori gli strumenti per monitorare i risultati della ricerca, aumentarne la visibilità e allocare in modo efficace le risorse disponibili.
EnglishThis paper presents a mixed reality system that, using the sensors mounted on the Microsoft Hololens headset and a cloud service, acquires and processes in real-time data to detect and track different kinds of objects and finally superimposes geographically coherent holographic texts on the detected objects. Such a goal has been achieved dealing with the intrinsic headset hardware limitations, by performing part of the overall computation in an edge/cloud environment. In particular, the heavier object detection algorithms, based on Deep Neural Networks (DNNs), are executed in the cloud. At the same time, we compensate for cloud transmission and computation latencies by running light scene detection and object tracking onboard the headset. The proposed pipeline allows meeting the real-time constraint by exploiting at the same time the power of state of art DNNs and the potential of Microsoft Hololens. This paper presents the design choices and describes the original algorithmic steps we devised to achieve real-time tracking in mixed reality. Finally, the proposed system is experimentally validated.
Real-time object detection and tracking in mixed reality using Microsoft HoloLens / Farasin, Alessandro; Peciarolo, Francesco; Grangetto, Marco; Gianaria, Elena; Garza, Paolo. - ELETTRONICO. - 4(2020), pp. 165-172. ((Intervento presentato al convegno VISIGRAPP 2020 - 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications tenutosi a Valletta (MT) nel 27/02/2020 - 29/02/2020.
| Titolo: | Real-time object detection and tracking in mixed reality using Microsoft HoloLens | |
| Autori: | ||
| Data di pubblicazione: | 2020 | |
| Abstract: | This paper presents a mixed reality system that, using the sensors mounted on the Microsoft Holol...ens headset and a cloud service, acquires and processes in real-time data to detect and track different kinds of objects and finally superimposes geographically coherent holographic texts on the detected objects. Such a goal has been achieved dealing with the intrinsic headset hardware limitations, by performing part of the overall computation in an edge/cloud environment. In particular, the heavier object detection algorithms, based on Deep Neural Networks (DNNs), are executed in the cloud. At the same time, we compensate for cloud transmission and computation latencies by running light scene detection and object tracking onboard the headset. The proposed pipeline allows meeting the real-time constraint by exploiting at the same time the power of state of art DNNs and the potential of Microsoft Hololens. This paper presents the design choices and describes the original algorithmic steps we devised to achieve real-time tracking in mixed reality. Finally, the proposed system is experimentally validated. | |
| ISBN: | 978-989-758-402-2 | |
| Appare nelle tipologie: | 4.1 Contributo in Atti di convegno |
File in questo prodotto:
| File | Descrizione | Tipologia | Licenza | |
|---|---|---|---|---|
| VISAPP_2020_21_postprint.pdf | Articolo principale | 2a Post-print versione editoriale / Version of Record | Non Pubblico - Accesso privato/ristretto | Administrator Richiedi una copia |
http://hdl.handle.net/11583/2823713
Copyright © 2021