This paper presents a transformative modeling framework that guides the development of assessment to measure students' deep understanding in physical sciences. The framework emphasizes 3 types of connections that students need to make when learning physical sciences: (1) linking physical states, processes, and explanatory models, (2) integrating…

The purpose of our study was to examine the issue of answer changing in relation to students' abilities to monitor their behaviour accurately while responding to multiple-choice tests. The data for this study were obtained from the final examination administered to students in an educational psychology course. The results of the study indicate…

Multiple-choice testing is considered one of the most effective and enduring forms of educational assessment that remains in practice today. This study presents a comprehensive review of the literature on multiple-choice testing in education focused, specifically, on the development, analysis, and use of the incorrect options, which are also…

Simulations were conducted to examine the effect of differential item functioning (DIF) on measurement consequences such as total scores, item response theory (IRT) ability estimates, and test reliability in terms of the ratio of true-score variance to observed-score variance and the standard error of estimation for the IRT ability parameter. The…

This study investigated the effect of cloze item practice on reading comprehension, where cloze items were either created by humans, by machine using natural language processing techniques, or randomly. Participants from Amazon Mechanical Turk (N = 302) took a pre-test, read a text, and took part in one of five conditions, Do-Nothing, Re-Read,…

The quality and standard of South African examination questions for the grade 12 examination have become an important issue for the South African education system. So far, the focus of empirical research has been on factors that lead to poor performance in the Physical sciences as well as the alignment of the grade 12 Physical Sciences examination…

While there is increasing evidence that learners pick up new words while viewing video with captions (i.e. L2 subtitles), little is known about the role of instructional interventions prior to viewing. This study uses eye-movement registration to investigate the effect of pre-learning vocabulary before watching a captioned video. Thirty…

This study focuses on the teachers' predictions of the students' performances -- in particular the middle-low achievers -- while solving tasks testing inquiry competencies. The tasks come from PISA science. More specifically we study science teachers' predictions for several aspects: levels of difficulty of the tasks, the potential sources of…

In science, graphs are used to visualise data, relationships and scientific principles. Basic graph reading operations, i.e. reading single data points, recognising trends as well as conducting small extrapolations from the data are important skills for pupils and lay the groundwork for a comprehensive understanding of data visualisations across…

This article describes the development of an assessment system for adolescent reading comprehension. It presents a research context--a reading intervention implemented in middle and high schools in an urban district--which became the impetus for the work. The article outlines the organizational principles of construct modeling that guided the…

Diagnostic assessments are intended to support teachers' instructional decision making by providing instructionally relevant information. In this article, we propose that using cognitive theories of learning to design diagnostic assessments can provide teachers with two diagnostic outcomes: (a) the location of a student's thinking within the…

The primary purpose of International Computer and Information Literacy Study (ICILS) 2018 is to assess systematically the capacities of students to use ICT productively for a range of different purposes, in ways that go beyond a basic use of ICT. ICILS 2018 includes authentic computer-based assessments that are administered to students in their…

The current study aims to determine the effect of multiple-choice, matching, gap-fill and word formation items used in assessing L2 vocabulary on learners' performance and to obtain the learners' views regarding the use of these types of items in vocabulary assessment. The convenience sampling method was selected, and the participants of the study…

Investigating the processes underlying test performance is a major source of data supporting the explanation inference in the validity argument (Chappelle, 2021). One way of modeling the cognitive processes underlying test performance is by constructing a Q-matrix, which is essentially about summarizing the attributes explaining test-takers'…

Efficient waste management is a major prerequisite for reaching sustainability as every one of us produces waste. Thus, educational interventions need to offer promising assistance to reduce individual waste as much as possible to promote environmentally friendly behavior beyond stereotypical notions about waste disposal. Those who know about all…