Benchmarking individual tree segmentation using multispectral airborne laser scanning data: the FGI-EMIT dataset

TL;DR

This paper introduces FGI-EMIT, a large-scale multispectral airborne LiDAR dataset for individual tree segmentation, and benchmarks traditional and deep learning methods, showing deep learning's superior performance especially for understory trees.

Contribution

The study provides the first large-scale multispectral LiDAR dataset for ITS and offers a comprehensive benchmark of unsupervised and supervised methods, highlighting the potential and limitations of current approaches.

Findings

Deep learning models outperform unsupervised algorithms in ITS accuracy.

ForestFormer3D achieves the highest F1-score of 73.3%.

DL methods are robust across varying point densities.

Abstract

Individual tree segmentation (ITS) from LiDAR point clouds is fundamental for applications such as forest inventory, carbon monitoring and biodiversity assessment. Traditionally, ITS has been achieved with unsupervised geometry-based algorithms, while more recent advances have shifted toward supervised deep learning (DL). In the past, progress in method development was hindered by the lack of large-scale benchmark datasets, and the availability of novel data formats, particularly multispectral (MS) LiDAR, remains limited to this day, despite evidence that MS reflectance can improve the accuracy of ITS. This study introduces FGI-EMIT, the first large-scale MS airborne laser scanning benchmark dataset for ITS. Captured at wavelengths 532, 905, and 1,550 nm, the dataset consists of 1,561 manually annotated trees, with a particular focus on small understory trees. Using FGI-EMIT, we comprehensively benchmarked four conventional unsupervised algorithms and four supervised DL approaches. Hyperparameters of unsupervised methods were optimized using a Bayesian approach, while DL models were trained from scratch. Among the unsupervised methods, Treeiso achieved the highest test set F1-score of 52.7%. The DL approaches performed significantly better overall, with the best model, ForestFormer3D, attaining an F1-score of 73.3%. The most significant difference was observed in understory trees, where ForestFormer3D exceeded Treeiso by 25.9 percentage points. An ablation study demonstrated that current DL-based approaches generally fail to leverage MS reflectance information when it is provided as additional input features, although single channel reflectance can improve accuracy marginally, especially for understory trees. A performance analysis across point densities further showed that DL methods consistently remain superior to unsupervised algorithms, even at densities as low as 10 points/m$^2$.