This study investigates the differential impacts of various online language assessment models--specifically, the Nonlinear Dynamic Individual-Centered Language Assessment (NDICLA), diagnostic assessment, and formative assessment--on the cognitive load and learning outcomes of English as a Foreign Language (EFL) learners within computer-assisted…

[This paper is part of the Focused Collection in Artificial Intelligence Tools in Physics Teaching and Physics Education Research.] Using a high-stakes thermodynamics exam as the sample (252 students, four multipart problems), we investigate the viability of four workflows for AI-assisted grading of handwritten student solutions. We find that the…

The principle of fairness in testing traditionally involves an assertion about the absence of bias, or that measurement should be impartial (i.e., not provide an unfair advantage or disadvantage), across groups of test takers. In more general-purposes language testing, a test taker's background knowledge is not typically considered relevant to the…

Active learning has often been reported to improve student outcomes in STEM courses. However, there are barriers to its implementation, and it is challenging to include this approach in large classrooms with fixed seating. This investigation explores the development of a novel approach in which the class contact time was reallocated for a general…

Assessment is among the inevitable components of a curriculum and directs students' learning. E-assessment, as prepared and administered with the use of ICT, provides opportunities to make the process easier in some aspects, but also brings certain challenges. This paper presents an e-assessment framework from a student perspective. Our study…

With the initial COVID-19 lockdown of March 2020 in Ireland, many modules in university programmes that were designed to be delivered face-to-face were suddenly switched to remote delivery. The difficulty for both lecturers and students in replicating face-to-face interaction and the frequent lack of lecturers' visibility of students' work in such…

There is growing literature on computerized dynamic assessment (C-DA) wherein individual items are accompanied by mediating prompts, but its effectiveness at fine-grained levels across time has not been explored sufficiently. This study constructed a computerized listening dynamic assessment (CLDA) system, where mediation was informed by an…

This study was conducted to analyze potential item parameter drift (IPD) impact on person ability estimates and classification accuracy when drift affects an examinee sub-group. Using a series of simulations, three factors were manipulated: (a) percentage of IPD items in the CAT exam, (b) percentage of examinees affected by IPD, and (c) item pool…

Conoley, Powers, and Gutkin (2020) have provided an assessment of the progress and lack thereof of school psychology as a profession toward school reformation, especially as related to their various earlier calls for changes in training and practice. Conoley and Gutkin especially (and I have been colleagues of both) have called for decades for an…

The use of computers in educational assessment is a widely explored territory. Several studies have been performed to show the effectiveness of computer-assisted assessment (CAA) and it has been accepted in various education sectors. However, due to the lack of sufficient infrastructure and other issues, the paper-based examination is still being…

I describe the motivation, structure, implementation, and student feedback of my mastery-based testing (MBT) system with a significant final exam component in Calculus I and II since 2016. Grades for each written assignment, quiz, and exam question were assigned on a Mastery/Progressing/Needs Improvement (M/P/NI) scale. Homework and quizzes could…

During this digital era, France, like many other countries, is undergoing a transition from paper-based assessments to digital assessments in education. There is a rising interest in technology-enhanced items which offer innovative ways to assess traditional competencies, as well as addressing problem solving skills, specifically in mathematics.…

Test-taking effort relates to performance on low-stakes tests; thus, researchers and assessment practitioners have investigated what influences students to put forth effort when completing these tests. Using a longitudinal design, we evaluated the often-cited effect of perceived test importance on test-taking effort. More specifically, a 29-item…

Experimental measures of working memory that minimize rehearsal and maximize attentional control best predict higher-order cognitive abilities. These tasks fundamentally differ from clinically administered span tasks, which do not control strategy use. Participants engaged in concurrent articulation (to limit rehearsal) or concurrent tapping (to…

Oral exams may be as old as academia itself, but they are now rare in STEM undergraduate courses in the U.S. Can they be resurrected to help students develop oral communication skills, foster a sense belonging to a scholarly community, and change how students approach learning? This past spring, as we transitioned to emergency remote learning, my…