Are there different types of online research impact?. Issue 1 (1st February 2019)

• Record Type: Journal Article
• Authors: Lemke, Steffen; Mehrazar, Maryam; Mazarakis, Athanasios; Peters, Isabella
• Is Part Of: Proceedings of the Association for Information Science and Technology. Volume 55:Issue 1(2018)
• Page Start: 282
• Page End: 289
• Publication Date: 2019-02-01
• Subjects: Research evaluation -- altmetrics -- social media analysis -- survey study; Information science -- Congresses; Information technology -- Congresses; Information science; Information technology; Conference papers and proceedings; 020
• DOI: 10.1002/pra2.2018.14505501031
• Languages: English
• ISSNs: 2373-9231

Abstract

ABSTRACT: While web‐based indicators for scientific impact – so‐called altmetrics – have an increasing uptake as means for research evaluation, many questions regarding their actual meanings remain unanswered. In this article we analyse the data from a survey about researchers' use of 107 online actions that underlie potential altmetrics to discover whether certain types of altmetrics (1) better reflect the judgments of researchers from certain career stages and (2) more reliably capture positive judgments than others. We apply variance analyses to reveal significant differences between the frequencies with which early‐stage researchers and professors perform various actions whose occurrences are counted as impact metrics (e.g., downloading, liking, or sharing of scientific publications). The findings imply varying degrees of representation of these groups in respective altmetrics. Moreover, by investigating how commonly various types of actions are used to express positive judgments, we disclose how reliably metrics can be used as proxies for positive impact. Our findings contribute to a more comprehensive understanding of the meaning of different web‐based metrics for scholarly impact and provide a basis for evidence‐based guidelines on how to use and interpret them.