Are Altmetric.com scores effective for research impact evaluation in the social sciences and humanities?

Altmetric.com is one of the leading and widely used commercial providers of altmetrics. Altmetrics is a broad term that encapsulates the collection of multiple digital indicators related to scholarly work (NISO, 2016). In this paper, the group of altmetrics provided by Altmetric.com is called Altmetric.com scores. This study assesses whether Altmetric.com scores are currently effective indicators to evaluate the research impact of social sciences and humanities (SSH). This research covers 1,253,028 records from the SSCI and A&HCI for five years (2013-2017), three publication types (articles, reviews, and proceedings papers), and 10 altmetrics provided by Altmetric.com to test the effectiveness of Altmetric.com scores through four proposed dimensions, including transparency, fairness, availability, and validity. Results show that the transparency of Altmetric.com scores is underexposed. And Altmetric.com scores favored English publications authored by North American researchers. Except for Altmetric attention score, Posts, Readers, and Tweeters, the data presence of most Altmetric.com scores was insufficient. As to research impact, Altmetric.com scores can help to reflect different impacts of SSH research. Overall, the results suggest that Altmetric.com scores are not yet sufficiently effective for evaluating the impact of SSH research though they can provide new insights into impact evaluation. (c) 2020 Elsevier Ltd. All rights reserved.

Automated summary

Altmetric.com is a leading and widely used commercial provider of altmetrics, but it lacks transparency and fairness. The study found that Altmetric.com scores can help reflect different impacts of SSH research, but currently they are not sufficiently effective for evaluating the impact of SSH research.