HorGait: A Hybrid Model for Accurate Gait Recognition in LiDAR Point Cloud Planar Projections

TL;DR

HorGait introduces a hybrid Transformer-based model utilizing large convolutional kernels for accurate gait recognition from LiDAR point cloud projections, outperforming existing methods on the SUSTech1K dataset.

Contribution

This paper presents a novel hybrid model with LHM Blocks and large kernel CNNs to enhance Transformer-based gait recognition from 3D LiDAR point clouds.

Findings

Achieves state-of-the-art results on SUSTech1K dataset

Demonstrates the effectiveness of hybrid models in point cloud gait recognition

Shows improved spatial interaction and reduced dumb patches in Transformer architecture

Abstract

Gait recognition is a remote biometric technology that utilizes the dynamic characteristics of human movement to identify individuals even under various extreme lighting conditions. Due to the limitation in spatial perception capability inherent in 2D gait representations, LiDAR can directly capture 3D gait features and represent them as point clouds, reducing environmental and lighting interference in recognition while significantly advancing privacy protection. For complex 3D representations, shallow networks fail to achieve accurate recognition, making vision Transformers the foremost prevalent method. However, the prevalence of dumb patches has limited the widespread use of Transformer architecture in gait recognition. This paper proposes a method named HorGait, which utilizes a hybrid model with a Transformer architecture for gait recognition on the planar projection of 3D point clouds from LiDAR. Specifically, it employs a hybrid model structure called LHM Block to achieve input adaptation, long-range, and high-order spatial interaction of the Transformer architecture. Additionally, it uses large convolutional kernel CNNs to segment the input representation, replacing attention windows to reduce dumb patches. We conducted extensive experiments, and the results show that HorGait achieves state-of-the-art performance among Transformer architecture methods on the SUSTech1K dataset, verifying that the hybrid model can complete the full Transformer process and perform better in point cloud planar projection. The outstanding performance of HorGait offers new insights for the future application of the Transformer architecture in gait recognition.