3D-ANC: Adaptive Neural Collapse for Robust 3D Point Cloud Recognition

TL;DR

This paper introduces 3D-ANC, a novel method leveraging Neural Collapse to improve robustness of 3D point cloud recognition models against adversarial attacks by creating more discriminative feature spaces.

Contribution

The paper proposes 3D-ANC, combining ETF-aligned classification with adaptive training to enhance feature disentanglement and robustness in 3D recognition models.

Findings

Significant accuracy improvement on ModelNet40 from 27.2% to 80.9%.

Outperforms existing baselines by 34.0%.

Enhances model robustness against adversarial perturbations.

Abstract

Deep neural networks have recently achieved notable progress in 3D point cloud recognition, yet their vulnerability to adversarial perturbations poses critical security challenges in practical deployments. Conventional defense mechanisms struggle to address the evolving landscape of multifaceted attack patterns. Through systematic analysis of existing defenses, we identify that their unsatisfactory performance primarily originates from an entangled feature space, where adversarial attacks can be performed easily. To this end, we present 3D-ANC, a novel approach that capitalizes on the Neural Collapse (NC) mechanism to orchestrate discriminative feature learning. In particular, NC depicts where last-layer features and classifier weights jointly evolve into a simplex equiangular tight frame (ETF) arrangement, establishing maximally separable class prototypes. However, leveraging this advantage in 3D recognition confronts two substantial challenges: (1) prevalent class imbalance in point cloud datasets, and (2) complex geometric similarities between object categories. To tackle these obstacles, our solution combines an ETF-aligned classification module with an adaptive training framework consisting of representation-balanced learning (RBL) and dynamic feature direction loss (FDL). 3D-ANC seamlessly empowers existing models to develop disentangled feature spaces despite the complexity in 3D data distribution. Comprehensive evaluations state that 3D-ANC significantly improves the robustness of models with various structures on two datasets. For instance, DGCNN's classification accuracy is elevated from 27.2% to 80.9% on ModelNet40 -- a 53.7% absolute gain that surpasses leading baselines by 34.0%.