The ability to evaluate arguments in scientific texts: Measurement, cognitive processes, nomological network, and relevance for academic success at the university. (17th June 2019)

• Record Type: Journal Article
• Authors: Münchow, Hannes; Richter, Tobias; von der Mühlen, Sarah; Schmid, Sebastian
• Other Names: Zlatkin‐Troitschanskaia Olga guestEditor.; Shavelson Richard J. guestEditor.
• Is Part Of: British journal of educational psychology. Volume 89:Number 3(2019)
• Page Start: 501
• Page End: 523
• Publication Date: 2019-06-17
• Subjects: plausibility judgements -- recognition of argumentation fallacies -- nomological network -- academic success; Educational psychology -- Periodicals; 370.1505
• DOI: 10.1111/bjep.12298
• Languages: English
• ISSNs: 0007-0998

Abstract

Abstract : Background: The evaluation of informal arguments is a key component of comprehending scientific texts and scientific literacy. Aim: The present study examined the nomological network of university students' ability to evaluate informal arguments in scientific texts and the relevance of this ability for academic success. Sample: A sample of 225 university students from the social and educational sciences participated in the study. Methods: Judgements of plausibility and the ability to recognize argumentation fallacies were assessed with a novel computer‐based diagnostic instrument (Argument Judgement Test; AJT). Results: The items of the AJT partly conform to a 1‐PL model and test scores were systematically related to epistemological beliefs and verbal intelligence. Item‐by‐item analyses of responses and response times showed that implausible arguments were more difficult to process and correct responses to these items required increased cognitive effort. Finally, the AJT scores predicted academic success at university even if verbal intelligence and grade point average were controlled for. Conclusion: These findings suggest that the ability to evaluate arguments in scientific texts is an aspect of rationality, relies on reflective processes, and is relevant for academic success.