Assessment of scientific reasoning: The effects of task context, data, and design on student reasoning in control of variables. (March 2016)

• Record Type: Journal Article
• Authors: Zhou, Shaona; Han, Jing; Koenig, Kathleen; Raplinger, Amy; Pi, Yuan; Li, Dan; Xiao, Hua; Fu, Zhao; Bao, Lei
• Is Part Of: Thinking skills and creativity. Volume 19(2016)
• Page Start: 175
• Page End: 187
• Publication Date: 2016-03
• Subjects: Scientific reasoning -- Control of variables -- Progression of reasoning -- Assessment context -- Multiple variable reasoning; Thought and thinking -- Periodicals; Critical thinking -- Study and teaching -- Periodicals; Creative thinking -- Study and teaching -- Periodicals; Thinking -- Periodicals; Creativeness -- Periodicals; Teaching -- Periodicals; Pensée -- Étude et enseignement -- Périodiques; Créativité (Éducation) -- Étude et enseignement -- Périodiques; 370.15205
• DOI: 10.1016/j.tsc.2015.11.004
• Languages: English
• ISSNs: 1871-1871

Abstract

Highlights: A controlled study on high school and college students' reasoning in control of variables. Examine if students' reasoning is affected by features of the tasks regarding experimental data, contexts, and embedded relations. Students perform better when experimental data are not provided. Students perform better in physics contexts than in real-life contexts. Students have a tendency to equate non-influential variables to non-testable variables. The results informed the development of a fine grained progression of reasoning skills in control of variables. Abstract: Scientific reasoning is an important component under the cognitive strand of the 21st century skills and is highly emphasized in the new science education standards. This study focuses on the assessment of student reasoning in control of variables (COV), which is a core sub-skill of scientific reasoning. The main research question is to investigate the extent to which the existence of experimental data in questions impacts student reasoning and performance. This study also explores the effects of task contexts on student reasoning as well as students' abilities to distinguish between testability and causal influences of variables in COV experiments. Data were collected with students from both USA and China. Students received randomly one of two test versions, one with experimental data and one without. The results show that students from both populations (1) perform better when experimental data are not provided, (2) perform better in physics contexts than in real-life contexts, and (3) students have a tendency to equate non-influential variables to non-testable variables. In addition, based on the analysis of both quantitative and qualitative data, a possible progression of developmental levels of student reasoning in control of variables is proposed, which can be used to inform future development of assessment and instruction.