Studies have indicated that pictures in test items can impact item-solving performance, information processing (e.g., time on task) and metacognition as well as test-taking affect and motivation. The present review aims to better organize the existing and somewhat scattered research on multimedia effects in testing and problem solving while…

Machine learning methods can be used to reduce the manual workload in exam grading, making it possible for teachers to spend more time on other tasks. However, when it comes to grading exams, fully eliminating manual work is not yet possible even with very accurate automated grading, as any grading mistakes could have significant consequences for…

Automatic grading models are valued for the time and effort saved during the instruction of large student bodies. Especially with the increasing digitization of education and interest in large-scale standardized testing, the popularity of automatic grading has risen to the point where commercial solutions are widely available and used. However,…

This CALDER research brief builds on pioneering research by the Measures of Effective Teaching Project (Kane et al., 2013) and Jackson (2018) to look at two measures of teacher quality-value-added measures (VAMs) for both test outcomes and non-test outcomes--and what they can tell education leaders about the teacher workforce. Both measures use a…

We report six experiments that examine how two essential components of a category-learning paradigm, training and feedback, can be manipulated to maximize learning and transfer of real-world, complex concepts. Some subjects learned through classification and were asked to classify hypothetical experiment scenarios as either true or non-true…

This paper describes the Berlin "Abitur" examination in the twentieth century and its written documentation in files. By the late nineteenth century, the "Abitur" examination was fully established in Prussia and with it a graduation certificate that was obligatory for university entrance. Thus, the "Abitur"…

Minimum Competency Assessment (MCA) is the latest assessment conducted nationally in Indonesia. MCA measures students' cognitive in literacy and numeracy. This study illustrates the difficulty of students in solving numeracy questions in the minimum competency assessment. This research is included in case study research with a qualitative…

Remote or online proctoring (invigilating) is a technology primarily used to improve the integrity of online examinations. The use of remote proctoring increased significantly as the world switched to online assessment during the COVID-19 pandemic. Remote proctoring received negative media attention, including concerns about user privacy,…

Beginning with the 2020/21 school year, the Massachusetts Department of Elementary and Secondary Education (DESE) began an ongoing effort to collect and analyze literacy screening assessment data from schools and districts participating in certain state grants to inform improvement efforts. Grantee schools and districts that provide literacy…

Beginning with the 2020/21 school year, the Massachusetts Department of Elementary and Secondary Education (DESE) began an ongoing effort to collect and analyze early literacy screening assessment data from schools and districts participating in certain state grants to inform improvement efforts. Outcome data suggest that the current educational…

There has been a paradigm shift from accommodations to the identification of levels of accessibility (e.g., universal features, designated features, and accommodations). A consequence of this shift is that many students with disabilities who previously were assigned accommodations now access many of them as universal or designated features. This…

The New York State Education Department (NYSED) has a partnership with NWEA for the development of the 2024 Grades 3-8 English Language Arts Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2024 Grades 3 and 4 English Language…

We tested the impacts of Hofstede's cultural factors and mode of administration on item nonresponse (INR) for political questions in the European Values Study (EVS). We worked with the integrated European Values Study dataset, using descriptive analysis and multilevel binary logistic regression models. We concluded that (1) modes of administration…

Common indicator-based approaches to identifying careless and insufficient effort responding (C/IER) in survey data scan response vectors or timing data for aberrances, such as patterns signaling straight lining, multivariate outliers, or signals that respondents rushed through the administered items. Each of these approaches is susceptible to…

Take-home exam (THE) use has been reported in various disciplines, but research on THE use in language modules in higher education appears to be scarce. The current study employed surveys and interviews to examine how the shift to written THE, in place of the traditional in-class exam (ICE) during the pandemic, impacted language learning and…