ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., II-3/W5, 491-496, 2015
http://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/II-3-W5/491/2015/
doi:10.5194/isprsannals-II-3-W5-491-2015
© Author(s) 2015. This work is distributed
under the Creative Commons Attribution 3.0 License.
 
20 Aug 2015
REAL-TIME LARGE SCALE 3D RECONSTRUCTION BY FUSING KINECT AND IMU DATA
J. Huai, Y. Zhang, and A. Yilmaz Dept. of Civil, Environmental and Geodetic Engineering Dept, Ohio State University, 2036 Neil Avenue, Columbus, OH 43210 USA
Keywords: KinectFusion, IMU, SIFT Odometry, Large Scale Reconstruction Abstract. Kinect-style RGB-D cameras have been used to build large scale dense 3D maps for indoor environments. These maps can serve many purposes such as robot navigation, and augmented reality. However, to generate dense 3D maps of large scale environments is still very challenging. In this paper, we present a mapping system for 3D reconstruction that fuses measurements from a Kinect and an inertial measurement unit (IMU) to estimate motion. Our major achievements include: (i) Large scale consistent 3D reconstruction is realized by volume shifting and loop closure; (ii) The coarse-to-fine iterative closest point (ICP) algorithm, the SIFT odometry, and IMU odometry are combined to robustly and precisely estimate pose. In particular, ICP runs routinely to track the Kinect motion. If ICP fails in planar areas, the SIFT odometry provides incremental motion estimate. If both ICP and the SIFT odometry fail, e.g., upon abrupt motion or inadequate features, the incremental motion is estimated by the IMU. Additionally, the IMU also observes the roll and pitch angles which can reduce long-term drift of the sensor assembly. In experiments on a consumer laptop, our system estimates motion at 8Hz on average while integrating color images to the local map and saving volumes of meshes concurrently. Moreover, it is immune to tracking failures, and has smaller drift than the state-of-the-art systems in large scale reconstruction.
Conference paper (PDF, 14492 KB)


Citation: Huai, J., Zhang, Y., and Yilmaz, A.: REAL-TIME LARGE SCALE 3D RECONSTRUCTION BY FUSING KINECT AND IMU DATA, ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., II-3/W5, 491-496, doi:10.5194/isprsannals-II-3-W5-491-2015, 2015.

BibTeX EndNote Reference Manager XML