ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume VIII-M-1-2021
ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., VIII-M-1-2021, 155–162, 2021
https://doi.org/10.5194/isprs-annals-VIII-M-1-2021-155-2021
ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., VIII-M-1-2021, 155–162, 2021
https://doi.org/10.5194/isprs-annals-VIII-M-1-2021-155-2021

  27 Aug 2021

27 Aug 2021

3D SURVEYING, SEMANTIC ENRICHMENT AND VIRTUAL ACCESS OF LARGE CULTURAL HERITAGE

S. Teruggi1, E. Grilli2, F. Fassi1, and F. Remondino2 S. Teruggi et al.
  • 13DSurveyGroup, ABCLab, Politecnico di Milano, via Ponzio 31, 20133 Milano, Italy
  • 23D Optical Metrology (3DOM) unit, Bruno Kessler Foundation (FBK), Trento, Italy

Keywords: 3D Point cloud, 3D classification, Augmented Reality, Mixed Reality, HoloLens

Abstract. In recent years, Artificial Intelligence (AI) methods for 3D point cloud classification has assumed an essential role in the heritage field. The association of semantic information to 3D representations became a valuable instrument for measurement, analysis, education or maintenance, in particular in the Cultural Heritage (CH) sector. Moreover, the recent availability and reliability of head-mounted displays and glasses are allowing extraordinary immersive virtual experiences. This paper presents an end-to-end framework to handle large and complex 3D point clouds, from acquisition to semantic segmentation and final access in a Mixed Reality (MR) environment. Three completely different heritage scenarios are considered: the Temple of Neptune in Paestum, the Milan Cathedral and a large portion of Bologna’s porticoes. Mixed Reality experiences are described and shown based on the Microsoft HoloLens 2 device. A video of the results is available at https://youtu.be/Kd_3s0tIX04.