NormalView: sensor-agnostic tree species classification from backpack and aerial lidar data using geometric projections

TL;DR

NormalView is a sensor-agnostic deep learning approach that classifies tree species from point cloud data by embedding local geometric features into 2D projections, achieving high accuracy across different sensors.

Contribution

The paper introduces NormalView, a novel projection-based method that leverages geometric information for sensor-agnostic tree species classification from lidar data.

Findings

Achieves 95.5% accuracy on MLS data

Achieves 91.8% accuracy on ALS data

Intensity information improves classification performance

Abstract

Laser scanning has proven to be an invaluable tool in assessing the decomposition of forest environments. Mobile laser scanning (MLS) has shown to be highly promising for extremely accurate, tree level inventory. In this study, we present NormalView, a sensor-agnostic projection-based deep learning method for classifying tree species from point cloud data. NormalView embeds local geometric information into two-dimensional projections, in the form of normal vector estimates, and uses the projections as inputs to an image classification network, YOLOv11. In addition, we inspected the effect of multispectral radiometric intensity information on classification performance. We trained and tested our model on high-density MLS data (7 species, ~5000 pts/m^2), as well as high-density airborne laser scanning (ALS) data (9 species, >1000 pts/m^2). On the MLS data, NormalView achieves an overall accuracy (macro-average accuracy) of 95.5 % (94.8 %), and 91.8 % (79.1 %) on the ALS data. We found that having intensity information from multiple scanners provides benefits in tree species classification, and the best model on the multispectral ALS dataset was a model using intensity information from all three channels of the multispectral ALS. This study demonstrates that projection-based methods, when enhanced with geometric information and coupled with state-of-the-art image classification backbones, can achieve exceptional results. Crucially, these methods are sensor-agnostic, relying only on geometric information. Additionally, we publically release the MLS dataset used in the study.