4.5 Article

Gatekeepers of science - Effects of external reviewers' attributes on the assessments of fellowship applications

期刊

JOURNAL OF INFORMETRICS
卷 1, 期 1, 页码 83-91

出版社

ELSEVIER SCIENCE BV
DOI: 10.1016/j.joi.2006.09.005

关键词

peer review; particularism; universalism; country of residence; gender; evaluation experience; judgmental tendencies

向作者/读者索取更多资源

Aim: The scientific norm of universalism prescribes that external reviewers recommend the allocation of awards to young scientists solely on the basis of their scientific achievement. Since the evaluation of grants utilizes scientists with different personal attributes, it is natural to ask whether the norm of universalism reflects the actual evaluation practice. Subjects and methods: We investigated the influence of three attributes of external reviewers on their ratings in the selection procedure followed by the Boehringer Ingelheim Fonds (B.I.F.) for awarding long-term fellowships to doctoral and post-doctoral researchers in biomedicine: (i) number of applications assessed in the past for the B. I. F. (reviewers' evaluation experience), (ii) the reviewers' country of residence and (iii) the reviewers' gender. To analyze the reviewers' ratings (1: award; 2: maybe award; 3: no award) in an ordinal regression model (ORM) the following were considered in addition to the three attributes: (i) the scientific achievements of the fellowship applicants, (ii) interaction effects between reviewers' and applicants' attributes and (iii) judgmental tendencies of reviewers. Results: The results of the model estimations show no significant effect of the reviewers' attributes on the evaluation of B. I. F. fellowship applications. The ratings of the external reviewers are mainly determined by the applicants' scientific achievement prior to application. Conclusions: The results suggest that the external reviewers of the B. I. F. indeed achieved the foundation's goal of recommending applicants with higher scientific achievement for fellowships and of recommending those with lower scientific achievement for rejection. (c) 2006 Elsevier Ltd. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.5
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据