ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., IV-1/W1, 115-123, 2017
https://doi.org/10.5194/isprs-annals-IV-1-W1-115-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
 
30 May 2017
INVESTIGATIONS ON THE POTENTIAL OF CONVOLUTIONAL NEURAL NETWORKS FOR VEHICLE CLASSIFICATION BASED ON RGB AND LIDAR DATA
R. Niessner1, H. Schilling1, and B. Jutzi2 1Fraunhofer Institute of Optronics, System Technologies and Image Exploitation, Gutleuthausstr. 1, 76275 Ettlingen, Germany
2Institute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology (KIT), Englerstr. 7, Germany
Keywords: CNN, data fusion, airborne laserscanning, orthofoto, vehicle classification Abstract. In recent years, there has been a significant improvement in the detection, identification and classification of objects and images using Convolutional Neural Networks. To study the potential of the Convolutional Neural Network, in this paper three approaches are investigated to train classifiers based on Convolutional Neural Networks. These approaches allow Convolutional Neural Networks to be trained on datasets containing only a few hundred training samples, which results in a successful classification. Two of these approaches are based on the concept of transfer learning. In the first approach features, created by a pretrained Convolutional Neural Network, are used for a classification using a support vector machine. In the second approach a pretrained Convolutional Neural Network gets fine-tuned on a different data set. The third approach includes the design and training for flat Convolutional Neural Networks from the scratch. The evaluation of the proposed approaches is based on a data set provided by the IEEE Geoscience and Remote Sensing Society (GRSS) which contains RGB and LiDAR data of an urban area. In this work it is shown that these Convolutional Neural Networks lead to classification results with high accuracy both on RGB and LiDAR data. Features which are derived by RGB data transferred into LiDAR data by transfer learning lead to better results in classification in contrast to RGB data. Using a neural network which contains fewer layers than common neural networks leads to the best classification results. In this framework, it can furthermore be shown that the practical application of LiDAR images results in a better data basis for classification of vehicles than the use of RGB images.
Conference paper (PDF, 3350 KB)


Citation: Niessner, R., Schilling, H., and Jutzi, B.: INVESTIGATIONS ON THE POTENTIAL OF CONVOLUTIONAL NEURAL NETWORKS FOR VEHICLE CLASSIFICATION BASED ON RGB AND LIDAR DATA, ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., IV-1/W1, 115-123, https://doi.org/10.5194/isprs-annals-IV-1-W1-115-2017, 2017.

BibTeX EndNote Reference Manager XML