Fractional counting of citations in research evaluation: A cross- and interdisciplinary assessment of the Tsinghua University in Beijing

TL;DR

This paper proposes a fractional citation counting method based on reference list lengths to normalize impact across disciplines, enabling fairer comparisons of research units like Tsinghua University departments.

Contribution

It introduces a novel fractional counting approach for citations that accounts for disciplinary differences, improving research evaluation accuracy.

Findings

The method allows comparison of units across disciplines at the paper level.

Most departments show no significant difference in impact after normalization.

The Department of Chinese Language and Linguistics significantly improved in ranking.

Abstract

In the case of the scientometric evaluation of multi- or interdisciplinary units one risks to compare apples with oranges: each paper has to be assessed in comparison to an appropriate reference set. We suggest that the set of citing papers can be considered as the relevant representation of the field of impact. In order to normalize for differences in citation behavior among fields, citations can be fractionally counted proportionately to the length of the reference lists in the citing papers. This new method enables us to compare among units with different disciplinary affiliations at the paper level and also to assess the statistical significance of differences among sets. Twenty-seven departments of the Tsinghua University in Beijing are thus compared. Among them, the Department of Chinese Language and Linguistics is upgraded from the 19th to the second position in the ranking. The overall impact of 19 of the 27 departments is not significantly different at the 5% level when thus normalized for different citation potentials.