Scientometric Analysis of the German IR Community within TREC & CLEF
A. K. Kruff, P. Schaer
TL;DR
This study analyzes the influence and productivity of the German IR community in TREC and CLEF from 2000 to 2022, revealing their main contributions to CLEF and confirming Lotka's Law at the institutional and researcher levels.
Contribution
It provides a comprehensive scientometric analysis of the German IR community's contributions to TREC and CLEF using metadata from OpenAlex and GROBID.
Findings
German IR community mainly contributed to CLEF
Productivity follows Lotka's Law
Analysis at institutional and researcher levels
Abstract
Within this study, the influence of the German Information Retrieval community on the retrieval campaigns Text Retrieval Conference (TREC) and Conference and Labs of the Evaluation Forum (CLEF) between 2000 and 2022 was analyzed based on metadata provided by OpenAlex and further metadata extracted with the GROBID framework from the publication's full texts. The analysis was conducted at the institutional and researcher levels. It was found that the German IR community, both on the author and institution level, mainly contributed to CLEF. Furthermore, it was shown that productivity follows the assumptions made by Lotka's Law.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCancer Genomics and Diagnostics · Library Science and Information Systems · Wikis in Education and Collaboration