PSTR: End-to-End One-Step Person Search With Transformers
Jiale Cao, Yanwei Pang, Rao Muhammad Anwer, Hisham Cholakkal, and Jin Xie, Mubarak Shah, Fahad Shahbaz Khan

TL;DR
This paper introduces PSTR, a novel end-to-end transformer-based framework that jointly performs person detection and re-identification in a single architecture, achieving state-of-the-art results on benchmark datasets.
Contribution
It is the first to propose an end-to-end one-step transformer-based person search framework combining detection and re-id with multi-scale and part attention mechanisms.
Findings
Sets new state-of-the-art on CUHK-SYSU and PRW benchmarks.
Achieves 56.5% mAP on PRW benchmark.
Demonstrates the effectiveness of joint detection and re-id with transformers.
Abstract
We propose a novel one-step transformer-based person search framework, PSTR, that jointly performs person detection and re-identification (re-id) in a single architecture. PSTR comprises a person search-specialized (PSS) module that contains a detection encoder-decoder for person detection along with a discriminative re-id decoder for person re-id. The discriminative re-id decoder utilizes a multi-level supervision scheme with a shared decoder for discriminative re-id feature learning and also comprises a part attention block to encode relationship between different parts of a person. We further introduce a simple multi-scale scheme to support re-id across person instances at different scales. PSTR jointly achieves the diverse objectives of object-level recognition (detection) and instance-level matching (re-id). To the best of our knowledge, we are the first to propose an end-to-end…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsVideo Surveillance and Tracking Methods · Gait Recognition and Analysis · IoT and GPS-based Vehicle Safety Systems
