The purpose of our study was to examine the issue of answer changing in relation to students' abilities to monitor their behaviour accurately while responding to multiple-choice tests. The data for this study were obtained from the final examination administered to students in an educational psychology course. The results of the study indicate…

Multiple-choice testing is considered one of the most effective and enduring forms of educational assessment that remains in practice today. This study presents a comprehensive review of the literature on multiple-choice testing in education focused, specifically, on the development, analysis, and use of the incorrect options, which are also…

Simulations were conducted to examine the effect of differential item functioning (DIF) on measurement consequences such as total scores, item response theory (IRT) ability estimates, and test reliability in terms of the ratio of true-score variance to observed-score variance and the standard error of estimation for the IRT ability parameter. The…

This study investigated the effect of cloze item practice on reading comprehension, where cloze items were either created by humans, by machine using natural language processing techniques, or randomly. Participants from Amazon Mechanical Turk (N = 302) took a pre-test, read a text, and took part in one of five conditions, Do-Nothing, Re-Read,…

The quality and standard of South African examination questions for the grade 12 examination have become an important issue for the South African education system. So far, the focus of empirical research has been on factors that lead to poor performance in the Physical sciences as well as the alignment of the grade 12 Physical Sciences examination…

To measure the response style of acquiescence, researchers recommend the use of at least 15 items with heterogeneous content. Such an approach is consistent with its theoretical definition and is a substantial improvement over traditional methods. Nevertheless, measurement of acquiescence can be enhanced by two additional considerations: first, to…

Partially compensatory models may capture the cognitive skills needed to answer test items more realistically than compensatory models, but estimating the model parameters may be a challenge. Data were simulated to follow two different partially compensatory models, a model with an interaction term and a product model. The model parameters were…

Students tend to have poor metacomprehension when learning from text, meaning they are not able to distinguish between what they have understood well and what they have not. Although there are a good number of studies that have explored comprehension monitoring accuracy in laboratory experiments, fewer studies have explored this in authentic…

In educational assessments two types of missing responses can be discerned: items can be "not reached" or "skipped". Both types of omissions may be related to the test taker's proficiency, resulting in non-ignorable missingness. This paper proposes to model not reached and skipped items as part of the response process, using…

While there is increasing evidence that learners pick up new words while viewing video with captions (i.e. L2 subtitles), little is known about the role of instructional interventions prior to viewing. This study uses eye-movement registration to investigate the effect of pre-learning vocabulary before watching a captioned video. Thirty…

This study focuses on the teachers' predictions of the students' performances -- in particular the middle-low achievers -- while solving tasks testing inquiry competencies. The tasks come from PISA science. More specifically we study science teachers' predictions for several aspects: levels of difficulty of the tasks, the potential sources of…

In science, graphs are used to visualise data, relationships and scientific principles. Basic graph reading operations, i.e. reading single data points, recognising trends as well as conducting small extrapolations from the data are important skills for pupils and lay the groundwork for a comprehensive understanding of data visualisations across…

This article describes the development of an assessment system for adolescent reading comprehension. It presents a research context--a reading intervention implemented in middle and high schools in an urban district--which became the impetus for the work. The article outlines the organizational principles of construct modeling that guided the…

Diagnostic assessments are intended to support teachers' instructional decision making by providing instructionally relevant information. In this article, we propose that using cognitive theories of learning to design diagnostic assessments can provide teachers with two diagnostic outcomes: (a) the location of a student's thinking within the…

The primary purpose of International Computer and Information Literacy Study (ICILS) 2018 is to assess systematically the capacities of students to use ICT productively for a range of different purposes, in ways that go beyond a basic use of ICT. ICILS 2018 includes authentic computer-based assessments that are administered to students in their…