This article deals with a theory-based investigation of the diagnostic problem-solving process in professional contexts. To begin with, a theory of the diagnostic problem-solving process was developed drawing on findings from different professional contexts. The theory distinguishes between four sub-processes of the diagnostic problem-solving…

A multistage adaptive testing (MST) design was implemented for the Programme for the International Assessment of Adult Competencies (PIAAC) starting in 2012 for about 40 countries and has been implemented for the 2018 cycle of the Programme for International Student Assessment (PISA) for more than 80 countries. Using examples from PISA and PIAAC,…

The paper deals with the problem of carrying on online written exams in the University of Milan, suddenly closed due to the Covid-19 emergency. Main goal of the paper is to present and compare the different scenarios envisioned, depending on the number of students to be monitored in parallel to avoid cheating. For limited numbers, direct…

This review critiques the highly-praised and influential 2001 study, "Getting Tough? The Impact of High School Graduation Exams," which concluded that "minimum competency," or high school "graduation exams," had no effect on student achievement. The review compares the test classifications of "Getting…

National large-scale assessments (NLSA) have spread rapidly since the 1990s, but contrary to arguments of diffusion theories, not every country with large-scale assessments develop test-based accountability (TBA). The diverse-case comparison presented in this article demonstrates that the interaction between global pressures and domestic policy…

Retrieval practice promotes retention more than restudying (i.e., the "testing effect") and is applied to many educational settings. However, little research has investigated means to enhance this effect in educational settings. Theoretical accounts assume retrieval practice to be the most effective whenever retrieval is difficult but…

This study develops a framework to conceptualize the use and evolution of machine learning (ML) in science assessment. We systematically reviewed 47 studies that applied ML in science assessment and classified them into five categories: (a) constructed response, (b) essay, (c) simulation, (d) educational game, and (e) inter-discipline. We compared…

Restricting one's access to temptations (precommitment) facilitates the achievement of long-term goals. The sophisticated impulsiveness model of precommitment posits that impulsive agents who are aware that they are impulsive should show the strongest preference for precommitment. Empirically however, two central predictions of this theoretical…

Psychophysiological responses have been studied as objective indicators for measuring a learner's cognitive load. Previous studies have correlated pupil dilation or fixation length with increased cognitive load. Our aims were to confirm whether these findings could be applied in a general learning context and to verify the additivity hypothesis of…

Pearson now uses a technology-based testing platform, Q-Interactive, to administer tests previously available in paper versions. The same norms are used for both versions; Pearson's in-house equivalency studies indicated that both versions are equated. The goal of the current study is to independently evaluate equivalency findings. For the current…

Retrospective pretests ask respondents to report after an intervention on their aptitudes, knowledge, or beliefs before the intervention. A primary reason to administer a retrospective pretest is that in some situations, program participants may over the course of an intervention revise or recalibrate their prior understanding of program content,…

Testing programs are often interested in using a student growth measure. This article presents analytic derivations of the accuracy of common student growth measures on both the raw scale of the test and the percentile rank scale in terms of the proportional reduction in mean squared error and the squared correlation between the estimator and…

Reducing risk associated with college student drinking is a major public health concern. The free-pour assessment has the potential to inform interventions aimed at reducing risks associated with college student drinking. Yet, few studies have assessed conditions that influence pouring abilities, and no identified studies have assessed pouring…

This study reports on the experiences students registered for a first-year, undergraduate English Studies module and English Studies lecturers had with the Invigilator app during an online examination in the first semester of 2023. Current research indicates that e-proctoring induces anxiety and uncertainty in students when they write online…

Online teaching has gained more momentum since the outbreak of the COVID-19 pandemic. While this mode offers many benefits, one major concern is maintaining academic integrity, as online instruction can provide more opportunities for cheating. This study aimed to explore students' attitudes toward cheating in online assessments (OAs) and any…