Attitudes of referees in a multidisciplinary journal: An empirical analysis. (15th April 2016)

• Record Type: Journal Article
• Authors: Casnici, Niccolò; Grimaldo, Francisco; Gilbert, Nigel; Squazzoni, Flaminio
• Is Part Of: Journal of the Association for Information Science and Technology. Volume 68:Number 7(2017:Jul.)
• Page Start: 1763
• Page End: 1771
• Publication Date: 2016-04-15
• Subjects: Information science -- Periodicals; Information technology -- Periodicals; 020.5
• DOI: 10.1002/asi.23665
• Languages: English
• ISSNs: 2330-1635

Abstract

Abstract : This paper looks at 10 years of reviews in a multidisciplinary journal, The Journal of Artificial Societies and Social Simulation (JASSS), which is the flagship journal of social simulation. We measured referee behavior and referees' agreement. We found that the disciplinary background and the academic status of the referee have an influence on the report time, the type of recommendation and the acceptance of the reviewing task. Referees from the humanities tend to be more generous in their recommendations than other referees, especially economists and environmental scientists. Second, we found that senior researchers are harsher in their judgments than junior researchers, and the latter accept requests to review more often and are faster in reporting. Finally, we found that articles that had been refereed and recommended for publication by a multidisciplinary set of referees were subsequently more likely to receive citations than those that had been reviewed by referees from the same discipline. Our results show that common standards of evaluation can be established even in multidisciplinary communities.