Architecture recognition by means of convolutional neural networks

The use of mobile computing technologies can change the experience of visiting cultural sites by making vast digital heritage collections accessible on site. The spread of machine learning technologies on mobile devices is encouraging the interaction of artificial intelligence with the shape of the built environment. However, while some research already applies deep learning image recognition in an urban context, the literature on how to develop effective neural networks to detect architectural features is still limited, as well as the availability of architecture-related datasets. This work presents the steps and results of the prototype development of a mobile app to perform monument recognition using convolutional neural networks. The tool allows users to interact with the physical space and access a digital archive of texts, models, images and other data.