With the initial COVID-19 lockdown of March 2020 in Ireland, many modules in university programmes that were designed to be delivered face-to-face were suddenly switched to remote delivery. The difficulty for both lecturers and students in replicating face-to-face interaction and the frequent lack of lecturers' visibility of students' work in such…

There is growing literature on computerized dynamic assessment (C-DA) wherein individual items are accompanied by mediating prompts, but its effectiveness at fine-grained levels across time has not been explored sufficiently. This study constructed a computerized listening dynamic assessment (CLDA) system, where mediation was informed by an…

This study was conducted to analyze potential item parameter drift (IPD) impact on person ability estimates and classification accuracy when drift affects an examinee sub-group. Using a series of simulations, three factors were manipulated: (a) percentage of IPD items in the CAT exam, (b) percentage of examinees affected by IPD, and (c) item pool…

Conoley, Powers, and Gutkin (2020) have provided an assessment of the progress and lack thereof of school psychology as a profession toward school reformation, especially as related to their various earlier calls for changes in training and practice. Conoley and Gutkin especially (and I have been colleagues of both) have called for decades for an…

The use of computers in educational assessment is a widely explored territory. Several studies have been performed to show the effectiveness of computer-assisted assessment (CAA) and it has been accepted in various education sectors. However, due to the lack of sufficient infrastructure and other issues, the paper-based examination is still being…

I describe the motivation, structure, implementation, and student feedback of my mastery-based testing (MBT) system with a significant final exam component in Calculus I and II since 2016. Grades for each written assignment, quiz, and exam question were assigned on a Mastery/Progressing/Needs Improvement (M/P/NI) scale. Homework and quizzes could…

During this digital era, France, like many other countries, is undergoing a transition from paper-based assessments to digital assessments in education. There is a rising interest in technology-enhanced items which offer innovative ways to assess traditional competencies, as well as addressing problem solving skills, specifically in mathematics.…

Test-taking effort relates to performance on low-stakes tests; thus, researchers and assessment practitioners have investigated what influences students to put forth effort when completing these tests. Using a longitudinal design, we evaluated the often-cited effect of perceived test importance on test-taking effort. More specifically, a 29-item…

Experimental measures of working memory that minimize rehearsal and maximize attentional control best predict higher-order cognitive abilities. These tasks fundamentally differ from clinically administered span tasks, which do not control strategy use. Participants engaged in concurrent articulation (to limit rehearsal) or concurrent tapping (to…

Oral exams may be as old as academia itself, but they are now rare in STEM undergraduate courses in the U.S. Can they be resurrected to help students develop oral communication skills, foster a sense belonging to a scholarly community, and change how students approach learning? This past spring, as we transitioned to emergency remote learning, my…

Since it was formalized by Kane, the argument-based approach to validation has been promoted as the preferred method for validating interpretations and uses of test scores. Because validation is discussed in terms of arguments, and arguments are both interactive and social, the present review systematically examines the scholarly arguments which…

An essential feature of episodic memory is the ability to recall the multiple elements relating to one event from the multitude of elements relating to other, potentially similar events. Hippocampal pattern separation is thought to play a fundamental role in this process, by orthogonalizing the representations of overlapping events during…

In this essay, Sarah Stitzlein describes the democratic potential of parents choosing to opt out of school testing, explaining how they ought to engage in political dissent to best fulfill their responsibilities as citizens and to practice democracy on behalf of children and schools. Parents' decisions to opt out are often based on rights claims…

Standard setting is arguably one of the most subjective techniques in test development and psychometrics. The decisions when scores are compared to standards, however, are arguably the most consequential outcomes of testing. Providing licensure to practice in a profession has high stake consequences for the public. Denying graduation or forcing…

A common belief is that the Bookmark method is a cognitively simpler standard-setting method than the modified Angoff method. However, a limited amount of research has investigated panelist's ability to perform well the Bookmark method, and whether some of the challenges panelists face with the Angoff method may also be present in the Bookmark…