Visual Person Understanding through Multi-Task and Multi-Dataset Learning
Kilian Pfeiffer, Alexander Hermans, Istv\'an S\'ar\'andi, Mark Weber,, Bastian Leibe
TL;DR
This paper presents a multi-task learning approach for comprehensive person understanding, combining multiple datasets to improve performance across re-identification, attribute classification, body segmentation, and pose estimation.
Contribution
It introduces a method to jointly learn multiple person-related tasks from diverse datasets without performance loss, suitable for resource-limited environments.
Findings
Multi-task learning improves overall accuracy.
Combining datasets enhances model robustness.
Shared parameters do not significantly increase computational cost.
Abstract
We address the problem of learning a single model for person re-identification, attribute classification, body part segmentation, and pose estimation. With predictions for these tasks we gain a more holistic understanding of persons, which is valuable for many applications. This is a classical multi-task learning problem. However, no dataset exists that these tasks could be jointly learned from. Hence several datasets need to be combined during training, which in other contexts has often led to reduced performance in the past. We extensively evaluate how the different task and datasets influence each other and how different degrees of parameter sharing between the tasks affect performance. Our final model matches or outperforms its single-task counterparts without creating significant computational overhead, rendering it highly interesting for resource-constrained scenarios such as…
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24
Figure 25
Figure 26
Figure 27
Figure 28
Figure 29
Figure 30
Figure 31
Figure 32
Figure 33
Figure 34
Figure 35
Figure 36
Figure 37
Figure 38
Figure 39
Figure 40Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.