Challenges of measuring software impact through citations: An examination of the lme4 R package. Issue 1 (February 2019)

• Record Type: Journal Article
• Authors: Li, Kai; Chen, Pei-Ying; Yan, Erjia
• Is Part Of: Journal of informetrics. Volume 13:Issue 1(2019)
• Page Start: 449
• Page End: 461
• Publication Date: 2019-02
• Subjects: Software citation -- Citable object -- lme4; Library statistics -- Periodicals; Information science -- Statistical methods -- Periodicals; Bibliometrics -- Periodicals; Bibliothèques -- Statistiques -- Périodiques; Sciences de l'information -- Méthodes statistiques -- Périodiques; Bibliométrie -- Périodiques; 020.727
• DOI: 10.1016/j.joi.2019.02.007
• Languages: English
• ISSNs: 1751-1577

Abstract

Highlights: This study examines the distribution of citations to different citable objects related to lme4. Multiplicity of citable objects connected to software is a challenge to measuring its impact. The reassignment of the citation format of lme4 catalyzed its changing citation behavior. Abstract: The rise of software as a research object is mirrored by increasing interests in quantitative studies of scientific software. However, inconsistent citation practices have led most existing studies of this type to base their analysis of software impact on software name mentions, as identified in full-text publications. Despite its limitations, citation data exists in much greater quantities and covers a broader array of scientific fields than full-text data, and thus can support investigations with much wider scope. This paper aims to analyze the extent to which citation data can be used to reconstruct the impact of software. Specifically, we identify the variety of citable objects related to the lme4 R package and examine how the package's impact is dispersed across these objects. Our results shed light on a little-discussed challenge of using citation data to measure software impact: even within the category of formal citation, the same software object might be cited in different forms. We consider the implications of this challenge and propose a method to reconstruct the impact of lme4 through its citations nonetheless.