# PointNeXt-DBSCAN: a hybrid point cloud deep learning framework for multi-stage cotton leaf instance segmentation

## TL;DR

A new deep learning framework combines PointNeXt and DBSCAN to accurately segment cotton leaves at different growth stages, improving precision and reducing errors.

## Contribution

A hybrid PointNeXt-DBSCAN framework is introduced for multi-stage cotton leaf instance segmentation with improved accuracy and reduced over-segmentation.

## Key findings

- The framework achieved an mIoU of 0.9846 in semantic segmentation, a 7.2% improvement over PointNet++.
- Instance segmentation reached an ARI of 0.983 and reduced over-segmentation by 63%.
- The method maintains less than 3% error for small leaves (<5 cm²) and supports phenotypic trait extraction.

## Abstract

This study addresses the challenge of organ-level instance segmentation in cotton point clouds, which arises from significant morphological variations and leaf occlusion across growth stages. To achieve high-precision leaf extraction, a hybrid framework integrating PointNeXt and DBSCAN is proposed. A dataset containing 1,065 cotton plants from seedling to boll-opening stages was constructed via multi-view image reconstruction and augmented through random rotation and scaling. Methodologically, a two-stage pipeline was designed: semantic segmentation was first performed using the PointNeXt network, where its residual MLP blocks enhanced edge and local feature learning; instance segmentation was then conducted by applying density-adaptive DBSCAN clustering to the semantic results, effectively mitigating over-segmentation in emerging leaves. Experimental results indicate that the semantic segmentation achieved an mIoU of 0.9846, representing a 7.2% improvement over PointNet++. The subsequent instance segmentation attained an ARI of 0.983, reduced the over-segmentation rate by 63%, and maintained an error below 3% for leaves smaller than 5 cm2. The framework provides reliable technical support for the automated extraction of key phenotypic traits such as leaf area index and leaf inclination distribution.