4.6 Review

Measuring the developmental function of peer review: a multi-dimensional, cross-disciplinary analysis of peer review reports from 740 academic journals

期刊

PEERJ
卷 10, 期 -, 页码 -

出版社

PEERJ INC
DOI: 10.7717/peerj.13539

关键词

Peer review; Standards; Reviewers; Academic journals; Natural language processing

资金

  1. Spanish Ministry of Science, Innovation and Universities (MCIU)
  2. Spanish State Research Agency (AEI)
  3. European Regional Development Fund (ERDF) [RTI2018-095820B-I00]
  4. ''Department of Excellence'' grant from the Italian Ministry of Education, University and Research
  5. PRIN-MIUR (Progetti di Rilevante Interesse Nazionale ~Italian Ministry of University and Research) [20178TRM3F001]
  6. University of Milan [PSR2015-17]

向作者/读者索取更多资源

This study tested a quality assessment tool on a sample of 1.3 million reports submitted to 740 Elsevier journals. The results showed that the developmental standards of peer review are shared across research areas but with significant differences. Reports submitted to social science and economics journals have the highest developmental standards. Reports from junior reviewers, women, and reviewers from Western Europe are generally more developmental than those from senior, men, and reviewers working in academic institutions outside Western regions.
Reviewers do not only help editors to screen manuscripts for publication in academic journals; they also serve to increase the rigor and value of manuscripts by constructive feedback. However, measuring this developmental function of peer review is difficult as it requires fine-grained data on reports and journals without any optimal benchmark. To fill this gap, we adapted a recently proposed quality assessment tool and tested it on a sample of 1.3 million reports submitted to 740 Elsevier journals in 2018??? 2020. Results showed that the developmental standards of peer review are shared across areas of research, yet with remarkable differences. Reports submitted to social science and economics journals show the highest developmental standards. Reports from junior reviewers, women and reviewers from Western Europe are generally more developmental than those from senior, men and reviewers working in academic institutions outside Western regions. Our findings suggest that increasing the standards of peer review at journals requires effort to assess interventions and measure practices with context-specific and multi-dimensional frameworks.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

暂无数据
暂无数据