The present meta-analysis sought to quantify the average degree of aggregated test score distortion due to rapid guessing (RG). Included studies group-administered a low-stakes cognitive assessment, identified RG via response times, and reported the rate of examinees engaging in RG, the percentage of RG responses observed, and/or the degree of…

Although art has been subject to psychological research for some time, the artwork itself received little attention in quantitative research. The rating instrument for two-dimensional pictorial works ("RizbA") fills this gap by providing a tool for formal picture analysis. This study validates the questionnaire on 294 images created by…

It is well known that Newton's work on mechanics depended in a crucial way on the previous observations of Galileo. The key insight of Galileo was that one can analyze the motion of bodies using experiments and mathematical equations. One experimental observation that roughly emerges from this work in modern terms is that two objects of different…

This document describes a set of best practices for developing, implementing, and maintaining the critical process of scoring constructed-response tasks. These practices address both the use of human raters and automated scoring systems as part of the scoring process and cover the scoring of written, spoken, performance, or multimodal responses.…

Background: The COVID-19 pandemic disrupted higher education in many ways, such as the move to Emergency Remote Online Teaching and Learning (EROTL), often including a move to online assessments and examinations. With evidence of increased academic dishonesty in unproctored online assessment, institutions sought ways to ensure academic and…

Technological affordances have shown promising potential in advancing the delivery of corporate learning programmes designed for professional leadership development. However, there is a considerable challenge in evaluating learners' skill acquisition, with most of the past research relying on pre- and post-tests or other forms of self-reports to…

The purpose of this research was to evaluate the effect of item pool and selection algorithms on computerized classification testing (CCT) performance in terms of some classification evaluation metrics. For this purpose, 1000 examinees' response patterns using the R package were generated and eight item pools with 150, 300, 450, and 600 items…

Recent efforts to opt out of assessments have focused attention on the role that testing plays in accountability reforms in the United States. While opt-out activists often invoke the disproportionate impact of these reforms on communities of color, opting out has been more widespread in mostly White, affluent, and suburban communities. This study…

The expansion of student opportunity through the flexible spending of Education Scholarship Accounts (ESAs) builds in direct accountability to the parents who choose and hold the power of the purse. Families can select different schools and service providers if they are dissatisfied with how their student is faring. But ESAs can also be designed…

Background: Research reproducibility and effect replication has become a topic of major concern throughout the social sciences. During the last decade, low replication rates of published research findings became a major issue across disciplines in the social and behavioral sciences, leading to the public proclamation of a "replication…

Taking tests can trigger multiple emotions. To regulate emotions we might experience during test-taking situations, strategies such as reappraisal and suppression are often used. This study aimed to investigate if college students' cultural values affect their emotion regulation in test-taking situations. The sample included 298 college students.…

The data from universal screeners must be valid and reliable in order to use it to make appropriate decisions about how best to allocate resources to support students who are at risk of not passing the state achievement test. The instruments used as part of universal screening must also have diagnostic accuracy. This study examined the diagnostic…

Autism spectrum disorders (ASD) and schizophrenia represent different mental disorders, but intriguing similarities seem to appear.In the present meta-analysis, we examined theory of mind (ToM) impairments in adults with ASD or schizophrenia based on studies that have compared the two patient groups directly by using the same test-battery at the…

This case study is a demonstration of how an ethnographic study can be adapted to an online survey due to circumstantial challenges such as the COVID-19 pandemic. The researchers were the Director of Ed.D. and 11 doctoral students in a doctoral emphasis called Transformative Learning in the Global Community. The objective was to explore the social…

The prevalence of private supplementary tutoring (i.e. shadow education) is growing, particularly in nations with selective school exams. The hypothesis that tutoring attendance rises as pressure to perform increases has not yet been tested. Therefore, our research question is: does the likelihood of attending shadow education increase with an…