Efficient View Clustering and Selection for City-Scale 3D Reconstruction

TL;DR

This paper introduces a scalable, efficient method for city-scale 3D reconstruction from large image datasets by clustering views and selecting optimal subsets for reconstruction, enabling parallel processing and improved performance.

Contribution

The paper presents a novel view clustering and selection approach that significantly improves scalability and efficiency in large-scale 3D city reconstruction tasks.

Findings

Runs faster than existing methods due to independent clustering

Enables massive parallelization of the reconstruction process

Proven effective and scalable on urban datasets

Abstract

Image datasets have been steadily growing in size, harming the feasibility and efficiency of large-scale 3D reconstruction methods. In this paper, a novel approach for scaling Multi-View Stereo (MVS) algorithms up to arbitrarily large collections of images is proposed. Specifically, the problem of reconstructing the 3D model of an entire city is targeted, starting from a set of videos acquired by a moving vehicle equipped with several high-resolution cameras. Initially, the presented method exploits an approximately uniform distribution of poses and geometry and builds a set of overlapping clusters. Then, an Integer Linear Programming (ILP) problem is formulated for each cluster to select an optimal subset of views that guarantees both visibility and matchability. Finally, local point clouds for each cluster are separately computed and merged. Since clustering is independent from pairwise visibility information, the proposed algorithm runs faster than existing literature and allows for a massive parallelization. Extensive testing on urban data are discussed to show the effectiveness and the scalability of this approach.