Attention-Guided Multi-Scale Local Reconstruction for Point Clouds via Masked Autoencoder Self-Supervised Learning

TL;DR

PointAMaLR introduces a novel self-supervised learning framework for point clouds that leverages attention-guided multi-scale local reconstruction and a local attention module to improve feature representation and reconstruction accuracy across multiple datasets.

Contribution

It proposes a hierarchical multi-scale local reconstruction method with attention guidance and a local attention module, enhancing feature learning in self-supervised point cloud processing.

Findings

Superior accuracy in classification and reconstruction on ModelNet and ShapeNet.

Highly competitive performance on real-world datasets like ScanObjectNN and S3DIS.

Effective multi-scale semantic understanding demonstrated through experiments.

Abstract

Self-supervised learning has emerged as a prominent research direction in point cloud processing. While existing models predominantly concentrate on reconstruction tasks at higher encoder layers, they often neglect the effective utilization of low-level local features, which are typically employed solely for activation computations rather than directly contributing to reconstruction tasks. To overcome this limitation, we introduce PointAMaLR, a novel self-supervised learning framework that enhances feature representation and processing accuracy through attention-guided multi-scale local reconstruction. PointAMaLR implements hierarchical reconstruction across multiple local regions, with lower layers focusing on fine-scale feature restoration while upper layers address coarse-scale feature reconstruction, thereby enabling complex inter-patch interactions. Furthermore, to augment feature representation capabilities, we incorporate a Local Attention (LA) module in the embedding layer to enhance semantic feature understanding. Comprehensive experiments on benchmark datasets ModelNet and ShapeNet demonstrate PointAMaLR's superior accuracy and quality in both classification and reconstruction tasks. Moreover, when evaluated on the real-world dataset ScanObjectNN and the 3D large scene segmentation dataset S3DIS, our model achieves highly competitive performance metrics. These results not only validate PointAMaLR's effectiveness in multi-scale semantic understanding but also underscore its practical applicability in real-world scenarios.