期刊
JOURNAL OF INFORMETRICS
卷 13, 期 4, 页码 -出版社
ELSEVIER
DOI: 10.1016/j.joi.2019.100979
关键词
Bibliometrics; Novelty; Creativity; Cited references; F1000Prime
资金
- National Natural Science Foundation of China [71673131]
Lee et al. (2015) - based on Uzzi et al. (2013) - and Wang et al. (2017) proposed scores based on cited references (cited journals) data which can be used to measure the novelty of papers (named as novelty scores U and Win this study). Although previous research has used novelty scores in various empirical analyses, no study has been published up to now to the best of our knowledge - which quantitatively tested the convergent validity of novelty scores: do these scores measure what they propose to measure? Using novelty assessments by faculty members (FMs) at F1000Prime for comparison, we tested the convergent validity of the two novelty scores (U and W). FMs' assessments do not only refer to the quality of biomedical papers, but also to their characteristics (by assigning certain tags to the papers): for example, are the presented findings or formulated hypotheses novel (tags new findings and hypothesis)? We used these and other tags to investigate the convergent validity of both novelty scores. Our study reveals different results for the novelty scores: the results for novelty score U are mostly in agreement with previously formulated expectations. We found, for instance, that for a standard deviation (one unit) increase in novelty score U, the expected number of assignments of the new finding tag increase by 7.47%. The results for novelty score W, however, do not reflect convergent validity with the FMs' assessments: only the results for some tags are in agreement with the expectations. Thus, we propose based on our results - the use of novelty score U for measuring novelty quantitatively, but question the use of novelty score W. (C) 2019 Elsevier Ltd. All rights reserved.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据