# Cross-Modality Person Re-Identification Method with Joint-Modality Generation and Feature Enhancement

**Authors:** Yihan Bi, Rong Wang, Qianli Zhou, Zhaolong Zeng, Ronghui Lin, Mingjie Wang

PMC · DOI: 10.3390/e26080681 · Entropy · 2024-08-13

## TL;DR

This paper introduces a new method for cross-modality person re-identification by combining modality generation and feature enhancement to improve performance.

## Contribution

The novel approach integrates joint-modality generation and feature enhancement using a lightweight network and attention modules.

## Key findings

- The proposed method improves Rank-1 accuracy by 7.12% and 6.34% on two datasets.
- mAP scores are enhanced by 4.00% and 6.05% on the same datasets.

## Abstract

In order to minimize the disparity between visible and infrared modalities and enhance pedestrian feature representation, a cross-modality person re-identification method is proposed, which integrates modality generation and feature enhancement. Specifically, a lightweight network is used for dimension reduction and augmentation of visible images, and intermediate modalities are generated to bridge the gap between visible images and infrared images. The Convolutional Block Attention Module is embedded into the ResNet50 backbone network to selectively emphasize key features sequentially from both channel and spatial dimensions. Additionally, the Gradient Centralization algorithm is introduced into the Stochastic Gradient Descent optimizer to accelerate convergence speed and improve generalization capability of the network model. Experimental results on SYSU-MM01 and RegDB datasets demonstrate that our improved network model achieves significant performance gains, with an increase in Rank-1 accuracy of 7.12% and 6.34%, as well as an improvement in mAP of 4.00% and 6.05%, respectively.

## Full-text entities

- **Cell lines:** SYSU-MM01 — Homo sapiens (Human), Embryonic stem cell (CVCL_C067)

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/PMC11353839/full.md

## Figures

9 figures with captions in the complete paper: https://tomesphere.com/paper/PMC11353839/full.md

## References

35 references — full list in the complete paper: https://tomesphere.com/paper/PMC11353839/full.md

---
Source: https://tomesphere.com/paper/PMC11353839