Toward the Integration of Peer Reviewing and Computational Linguistics Approaches. (March 2017)

• Record Type: Journal Article
• Authors: Park, Juhwa; Cho, Kwangsu
• Is Part Of: Journal of educational computing research. Volume 55:Number 1(2017:Mar.)
• Page Start: 123
• Page End: 144
• Publication Date: 2017-03
• Subjects: peer reviewing -- learning by reviewing -- SWoRD -- Coh-Metrix -- writing cohesion -- computational linguistics; Computer literacy -- Periodicals; Computer-assisted instruction -- Periodicals; Computer managed instruction -- Periodicals; Education -- Data processing -- Periodicals; 371.334
• DOI: 10.1177/0735633116656454
• Languages: English
• ISSNs: 0735-6331

Abstract

Previous research has shown the effectiveness of peer reviewing on the improvement of writing quality. However, the fact that students themselves, arguably novices, judged the improvement leads to concerns about the validity of peer reviewing. We measured writing quality before and after peer reviewing using Coh-Metrix, which computationally evaluates the linguistic properties of writings. Participants also evaluated the quality of their peer writings using the SWoRD system. Both measurements, particularly the computational measurement, confirmed the effectiveness of peer reviewing. In addition, the computational measures found that awareness of cohesion, including the clarity, explicitness, and concreteness of writing, improved over the course of peer reviewing. The results are discussed, along with their possible implications for the complementary roles of peer reviewing and computational writing measurements.