4.2 Article

Exploring the epistemic impacts of academic performance indicators in the life sciences

Journal

RESEARCH EVALUATION
Volume 26, Issue 3, Pages 157-168

Publisher

OXFORD UNIV PRESS
DOI: 10.1093/reseval/rvx023

Keywords

research evaluation; indicators; responsible metrics; quality

Funding

  1. GEN-AU/BMWF
  2. VIPS Impact Assessment Study - Vienna International Postdoc Program, Vienna Biocenter
  3. Sarah de Rijcke's Anna Boyksen Fellowship of the Institute for Advanced Study, Technical University of Munich (German Excellence Initiative)
  4. Faculty of Social Sciences, Leiden University
  5. Swedish Riksbankens Jubileumsfond

Ask authors/readers for more resources

While quantitative performance indicators are widely used by organizations and individuals for evaluative purposes, little is known about their impacts on the epistemic processes of academic knowledge production. In this article we bring together three qualitative research projects undertaken in the Netherlands and Austria to contribute to filling this gap. The projects explored the role of performance metrics in the life sciences, and the interactions between institutional and disciplinary cultures of evaluating research in these fields. Our analytic perspective is focused on understanding how researchers themselves give value to research, and in how far these practices are related to performance metrics. The article zooms in on three key moments in research processes to show how 'thinking with indicators' is becoming a central aspect of research activities themselves: (1) the planning and conception of research projects, (2) the social organization of research processes, and (3) determining the endpoints of research processes. Our findings demonstrate how the worth of research activities becomes increasingly assessed and defined by their potential to yield high value in quantitative terms. The analysis makes visible how certain norms and values related to performance metrics are stabilized as they become integrated into routine practices of knowledge production. Other norms and criteria for scientific quality, e.g. epistemic originality, long-term scientific progress, societal relevance, and social responsibility, receive less attention or become redefined through their relations to quantitative indicators. We understand this trend to be in tension with policy goals that seek to encourage innovative, societally relevant, and responsible research.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.2
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available