Reviewing, indicating, and counting books for modern research evaluation systems

TL;DR

This paper reviews the roles of various expert communities involved in improving book assessments within research evaluation systems, emphasizing empirical data and highlighting future challenges and opportunities for indicator development.

Contribution

It provides a comprehensive review of four expert communities' roles in enhancing book evaluation methods in research assessments, with insights into future challenges and potential improvements.

Findings

Identification of four key expert communities involved in book evaluation

Analysis of challenges faced by subject classifiers, indexers, and indicator constructionists

Potential for advancing quantitative and qualitative indicators in book-inclusive systems

Abstract

In this chapter, we focus on the specialists who have helped to improve the conditions for book assessments in research evaluation exercises, with empirically based data and insights supporting their greater integration. Our review highlights the research carried out by four types of expert communities, referred to as the monitors, the subject classifiers, the indexers and the indicator constructionists. Many challenges lie ahead for scholars affiliated with these communities, particularly the latter three. By acknowledging their unique, yet interrelated roles, we show where the greatest potential is for both quantitative and qualitative indicator advancements in book-inclusive evaluation systems.