PJB: A Reasoning-Aware Benchmark for Person-Job Retrieval
Guangzhi Wang, Xiaohui Yang, Kai Li, Jiawen He, Kai Yang, Ruixuan Zhang, Zhi Liu

TL;DR
PJB is a diagnostic benchmark for person-job retrieval that emphasizes understanding system failures and reasoning capabilities across real-world recruitment data, moving beyond simple score comparisons.
Contribution
It introduces a reasoning-aware evaluation dataset with diagnostic labels, grounded in real recruitment data, to analyze system failures and reasoning abilities in person-job matching.
Findings
Performance heterogeneity across industries exceeds module improvements.
Reranking consistently improves results, query understanding can degrade performance.
PJB provides a diagnostic tool to identify system weaknesses and guide development.
Abstract
As retrieval models converge on generic benchmarks, the pressing question is no longer "who scores higher" but rather "where do systems fail, and why?" Person-job matching is a domain that urgently demands such diagnostic capability -- it requires systems not only to verify explicit constraints but also to perform skill-transfer inference and job-competency reasoning, yet existing benchmarks provide no systematic diagnostic support for this task. We introduce PJB (Person-Job Benchmark), a reasoning-aware retrieval evaluation dataset that uses complete job descriptions as queries and complete resumes as documents, defines relevance through job-competency judgment, is grounded in real-world recruitment data spanning six industry domains and nearly 200,000 resumes, and upgrades evaluation from "who scores higher" to "where do systems differ, and why" through domain-family and…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMultimodal Machine Learning Applications · Topic Modeling · Recommender Systems and Techniques
