When research assessment exercises leave room for opportunistic behavior by the subjects under evaluation. Issue 3 (August 2019)

• Record Type: Journal Article
• Authors: Abramo, Giovanni; D'Angelo, Ciriaco Andrea; Di Costa, Flavia
• Is Part Of: Journal of informetrics. Volume 13:Issue 3(2019)
• Page Start: 830
• Page End: 840
• Publication Date: 2019-08
• Subjects: PBRF -- Bibliometrics -- Research policy -- R&D management -- Italy; Library statistics -- Periodicals; Information science -- Statistical methods -- Periodicals; Bibliometrics -- Periodicals; Bibliothèques -- Statistiques -- Périodiques; Sciences de l'information -- Méthodes statistiques -- Périodiques; Bibliométrie -- Périodiques; 020.727
• DOI: 10.1016/j.joi.2019.07.006
• Languages: English
• ISSNs: 1751-1577

Abstract

Highlights: We test the lack of opportunistic behavior by universities floowing the Italian VQR. VQR penalized university performance if professors resulted unproductive. Universities could reduce penalization favoring gift authorships. New productives show a higher than average share of intramural publications. Nevertheless opportunistic behavior by universities does not seem to take place. Abstract: This study inserts in the stream of research on the perverse effects that PBRF systems can induce in the subjects evaluated. The authors' opinion is that more often than not, it is the doubtful scientific basis of the evaluation criteria that leave room for opportunistic behaviors. The work examines the 2004–2010 Italian national research assessment (VQR) to test the lack of possible opportunistic behavior by universities in order to limit the penalization of their performance (and funding) due to the presence of scientifically unproductive professors in faculty. In particular, institutions may have favored "gift authorship" practices. The analysis thus focuses on the output of professors who were unproductive in the VQR publication window, but became productive ("new productives") in the following five years. A number of universities show a higher than average share of publications by new productives that are in co-authorship exclusively with colleagues from the same university. Although this might be thought to reflect opportunistic behavior by universities, the empirical evidence does not support this assumption.