The footprint of a metrics-based research evaluation system on Spanish philosophical scholarship: an analysis of researchers perceptions

TL;DR

This study explores how bibliometric-based research evaluation impacts Spanish philosophy researchers' behaviors, research agendas, and well-being, revealing both positive and negative effects on academic practices.

Contribution

It provides empirical insights into the perceptions of humanities scholars regarding the influence of metrics-based evaluation systems in Spain.

Findings

Research behavior is significantly affected, especially publication practices.

Evaluation influences research agendas and may lead to neglect of teaching.

Negative impacts include increased misconduct and mental health issues.

Abstract

The use of bibliometric indicators in research evaluation has a series of complex impacts on academic inquiry. These systems have gradually spread into a wide range of locations and disciplines, including the humanities. The aim of the present study is to examine their effects as perceived by philosophy researchers in Spain, a country where bibliometric indicators have long been used to evaluate research. The study combines data from a self-administered questionnaire completed by 201 researchers and from 14 in-depth interviews with researchers selected according to their affiliation, professional category, gender and area of knowledge. Results show that the evaluation system is widely perceived to affect research behaviour in significant ways, particularly related to publication practices (document type and publication language), the transformation of research agendas and the neglect of teaching work, as well as increasing research misconduct and negatively affecting mental health. Although to a lesser extent, other consequences included increased research productivity and enhanced transparency and impartiality in academic selection processes.