Role-play activities are considered a useful instructional design in enhancing the speaking performance of foreign language learners. However, in the traditional classroom context, learners may not readily have access to interlocutors for role-play activities. In this study, we proposed a designed method that integrated the GenAI agent into…

The integration of Generative Artificial Intelligence (GenAI) in education has introduced innovative approaches to assessment. One such approach is AI chatbot-based assessment, which utilizes large language models to provide students with timely and consistent feedback. However, the effectiveness of AI chatbots in generating assessments comparable…

In support of new local and state discussions about how to most effectively utilize technology in the classroom, Project Tomorrow, in collaboration with Spectrum Business®, is publishing a new series of reports that examine each of the three digital divides (the access, design and use divides) through the lens of the Speak Up Research findings.…

Certainty-based marking (CBM) requires students to indicate their certainty levels alongside their answers. CBM has been shown to enhance self-assessment and metacognitive awareness. This study aimed to explore the implementation of CBM in multiple-choice assessments in physiology. The CBM assessment tool was developed with an artificial…

Background/purpose: Generative artificial intelligence (GenAI) is often promoted as a transformative tool for assessment, yet evidence of its validity compared to human raters remains limited. This study examined whether an AI-based rater could be used interchangeably with trained faculty in scoring complex coursework. Materials/methods:…

This article deals with a theory-based investigation of the diagnostic problem-solving process in professional contexts. To begin with, a theory of the diagnostic problem-solving process was developed drawing on findings from different professional contexts. The theory distinguishes between four sub-processes of the diagnostic problem-solving…

A multistage adaptive testing (MST) design was implemented for the Programme for the International Assessment of Adult Competencies (PIAAC) starting in 2012 for about 40 countries and has been implemented for the 2018 cycle of the Programme for International Student Assessment (PISA) for more than 80 countries. Using examples from PISA and PIAAC,…

The paper deals with the problem of carrying on online written exams in the University of Milan, suddenly closed due to the Covid-19 emergency. Main goal of the paper is to present and compare the different scenarios envisioned, depending on the number of students to be monitored in parallel to avoid cheating. For limited numbers, direct…

This review critiques the highly-praised and influential 2001 study, "Getting Tough? The Impact of High School Graduation Exams," which concluded that "minimum competency," or high school "graduation exams," had no effect on student achievement. The review compares the test classifications of "Getting…

National large-scale assessments (NLSA) have spread rapidly since the 1990s, but contrary to arguments of diffusion theories, not every country with large-scale assessments develop test-based accountability (TBA). The diverse-case comparison presented in this article demonstrates that the interaction between global pressures and domestic policy…

Retrieval practice promotes retention more than restudying (i.e., the "testing effect") and is applied to many educational settings. However, little research has investigated means to enhance this effect in educational settings. Theoretical accounts assume retrieval practice to be the most effective whenever retrieval is difficult but…

This study develops a framework to conceptualize the use and evolution of machine learning (ML) in science assessment. We systematically reviewed 47 studies that applied ML in science assessment and classified them into five categories: (a) constructed response, (b) essay, (c) simulation, (d) educational game, and (e) inter-discipline. We compared…

Restricting one's access to temptations (precommitment) facilitates the achievement of long-term goals. The sophisticated impulsiveness model of precommitment posits that impulsive agents who are aware that they are impulsive should show the strongest preference for precommitment. Empirically however, two central predictions of this theoretical…

Psychophysiological responses have been studied as objective indicators for measuring a learner's cognitive load. Previous studies have correlated pupil dilation or fixation length with increased cognitive load. Our aims were to confirm whether these findings could be applied in a general learning context and to verify the additivity hypothesis of…

Pearson now uses a technology-based testing platform, Q-Interactive, to administer tests previously available in paper versions. The same norms are used for both versions; Pearson's in-house equivalency studies indicated that both versions are equated. The goal of the current study is to independently evaluate equivalency findings. For the current…