Building with Drones: Accurate 3D Facade Reconstruction using MAVs

TL;DR

This paper introduces an interactive, real-time 3D facade reconstruction system using drones, which provides online feedback on data quality and employs a novel multi-scale camera network to improve accuracy and prevent scene drift.

Contribution

It presents a closed-loop, incremental reconstruction approach with real-time feedback and a new multi-scale camera network design for drone-based 3D modeling.

Findings

Achieves high-accuracy 3D reconstructions in outdoor scenes

Provides real-time feedback on image quality parameters

Outperforms state-of-the-art methods in accuracy

Abstract

Automatic reconstruction of 3D models from images using multi-view Structure-from-Motion methods has been one of the most fruitful outcomes of computer vision. These advances combined with the growing popularity of Micro Aerial Vehicles as an autonomous imaging platform, have made 3D vision tools ubiquitous for large number of Architecture, Engineering and Construction applications among audiences, mostly unskilled in computer vision. However, to obtain high-resolution and accurate reconstructions from a large-scale object using SfM, there are many critical constraints on the quality of image data, which often become sources of inaccuracy as the current 3D reconstruction pipelines do not facilitate the users to determine the fidelity of input data during the image acquisition. In this paper, we present and advocate a closed-loop interactive approach that performs incremental reconstruction in real-time and gives users an online feedback about the quality parameters like Ground Sampling Distance (GSD), image redundancy, etc on a surface mesh. We also propose a novel multi-scale camera network design to prevent scene drift caused by incremental map building, and release the first multi-scale image sequence dataset as a benchmark. Further, we evaluate our system on real outdoor scenes, and show that our interactive pipeline combined with a multi-scale camera network approach provides compelling accuracy in multi-view reconstruction tasks when compared against the state-of-the-art methods.