The stability of Twitter metrics: A study on unavailable Twitter mentions of scientific publications. (24th February 2020)

• Record Type: Journal Article
• Authors: Fang, Zhichao; Dudek, Jonathan; Costas, Rodrigo
• Is Part Of: Journal of the Association for Information Science and Technology. Volume 71:Number 12(2020:Dec.)
• Page Start: 1455
• Page End: 1469
• Publication Date: 2020-02-24
• Subjects: Information science -- Periodicals; Information technology -- Periodicals; 020.5
• DOI: 10.1002/asi.24344
• Languages: English
• ISSNs: 2330-1635

Abstract

Abstract: This study investigated the stability of Twitter counts of scientific publications over time. For this, we conducted an analysis of the availability statuses of over 2.6 million Twitter mentions received by the 1, 154 most tweeted scientific publications recorded by Altmetric.com up to October 2017. The results show that of the Twitter mentions for these highly tweeted publications, about 14.3% had become unavailable by April 2019. Deletion of tweets by users is the main reason for unavailability, followed by suspension and protection of Twitter user accounts. This study proposes two measures for describing the Twitter dissemination structures of publications: Degree of Originality (i.e., the proportion of original tweets received by an article) and Degree of Concentration (i.e., the degree to which retweets concentrate on a single original tweet). Twitter metrics of publications with relatively low Degree of Originality and relatively high Degree of Concentration were observed to be at greater risk of becoming unstable due to the potential disappearance of their Twitter mentions. In light of these results, we emphasize the importance of paying attention to the potential risk of unstable Twitter counts, and the significance of identifying the different Twitter dissemination structures when studying the Twitter metrics of scientific publications.