HydraPlus-Net: Attentive Deep Features for Pedestrian Analysis

TL;DR

HydraPlus-Net (HP-net) is an attention-based deep neural network that enhances pedestrian analysis by capturing multi-level and multi-scale attentive features, improving performance in attribute recognition and re-identification tasks.

Contribution

The paper introduces HydraPlus-Net, a novel attention mechanism that feeds multi-level attention maps to different feature layers, enriching pedestrian feature representations.

Findings

HP-net outperforms state-of-the-art methods on multiple datasets.

The model effectively captures multi-scale attentive features.

Demonstrates versatility in pedestrian attribute recognition and re-identification.

Abstract

Pedestrian analysis plays a vital role in intelligent video surveillance and is a key component for security-centric computer vision systems. Despite that the convolutional neural networks are remarkable in learning discriminative features from images, the learning of comprehensive features of pedestrians for fine-grained tasks remains an open problem. In this study, we propose a new attention-based deep neural network, named as HydraPlus-Net (HP-net), that multi-directionally feeds the multi-level attention maps to different feature layers. The attentive deep features learned from the proposed HP-net bring unique advantages: (1) the model is capable of capturing multiple attentions from low-level to semantic-level, and (2) it explores the multi-scale selectiveness of attentive features to enrich the final feature representations for a pedestrian image. We demonstrate the effectiveness and generality of the proposed HP-net for pedestrian analysis on two tasks, i.e. pedestrian attribute recognition and person re-identification. Intensive experimental results have been provided to prove that the HP-net outperforms the state-of-the-art methods on various datasets.