Better Metrics for Ranking SE Researchers
George Mathew, Tim Menzies
TL;DR
This paper evaluates various metrics for ranking software engineering researchers, proposing a new Weighted Page Rank metric that considers collaboration frequency alongside citations, and provides a new top researcher ranking.
Contribution
It introduces the PR_W metric as an alternative to the h-index for better researcher ranking in SE, emphasizing collaboration.
Findings
PR_W correlates with citation counts and collaboration
h-index is deprecated in favor of PR_W
Provides a new top 20 SE researcher ranking
Abstract
This paper studies how SE researchers are ranked using a variety of metrics and data from 35,406 authors of 35,391 papers from 34 top SE venues in the period 1992-2016. Based on that analysis, we: deprecate the widely used "h-index", favoring instead an alternate Weighted Page Rank(PR_W) metric that is somewhat analogous to the PageRank(PR) metric developed at Google. Unlike the h-index, PR_W rewards not just citation counts but also how often authors collaborate. Using PR_W, we offer a ranking of the top 20 SE authors in the last decade.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsKnowledge Management and Sharing · scientometrics and bibliometrics research · Outsourcing and Supply Chain Management