Computer Adaptive Multistage Testing (ca-MST), which take the advantage of computer technology and adaptive test form, are widely used, and are now a popular issue of assessment and evaluation. This study aims at analyzing the effect of different panel designs, module lengths, and different sequence of a parameter value across stages and change in…

Physics faculty care about their students learning physics content. In addition, they usually hope that their students will learn some deeper lessons about thinking critically and scientifically. They hope that as a result of taking a physics class, students will come to appreciate physics as a coherent and logical method of understanding the…

The current study examined the criterion validity of a computer adaptive universal screener with an end-of-year state mathematics assessment using extant data provided by a local education agency. Participants included 1,195 third through eighth graders. Correlational analyses were used to report predictive and concurrent validity coefficients for…

This article reviews recent literature (2011-present) on the automated scoring (AS) of writing and speaking. Its purpose is to first survey the current research on automated scoring of language, then highlight how automated scoring impacts the present and future of assessment, teaching, and learning. The article begins by outlining the general…

This report provides an update on the state of the research on testing accommodations. Previous reports by the National Center on Educational Outcomes (NCEO) have covered research published since 1999. In this report, we summarize the research published in 2020. During 2020, 11 research studies addressed testing accommodations in the U.S. K-12…

The shift to online education has dealt several important pedagogical lessons in a very short time frame, none more so than approaches to assessments. This experience, coupled to improved access to education, will likely see online assessments remain as a major component of modern mainstream education. The powerful technologies that facilitate the…

The generalized S-X[superscript 2]-test is a test of item fit for items with polytomous responses format. The test is based on a comparison of the observed and expected number of responses in strata defined by the test score. In this article, we make four contributions. We demonstrate that the performance of the generalized S-X[superscript 2]-test…

The present meta-analysis sought to quantify the average degree of aggregated test score distortion due to rapid guessing (RG). Included studies group-administered a low-stakes cognitive assessment, identified RG via response times, and reported the rate of examinees engaging in RG, the percentage of RG responses observed, and/or the degree of…

Although art has been subject to psychological research for some time, the artwork itself received little attention in quantitative research. The rating instrument for two-dimensional pictorial works ("RizbA") fills this gap by providing a tool for formal picture analysis. This study validates the questionnaire on 294 images created by…

It is well known that Newton's work on mechanics depended in a crucial way on the previous observations of Galileo. The key insight of Galileo was that one can analyze the motion of bodies using experiments and mathematical equations. One experimental observation that roughly emerges from this work in modern terms is that two objects of different…

This document describes a set of best practices for developing, implementing, and maintaining the critical process of scoring constructed-response tasks. These practices address both the use of human raters and automated scoring systems as part of the scoring process and cover the scoring of written, spoken, performance, or multimodal responses.…

Background: The COVID-19 pandemic disrupted higher education in many ways, such as the move to Emergency Remote Online Teaching and Learning (EROTL), often including a move to online assessments and examinations. With evidence of increased academic dishonesty in unproctored online assessment, institutions sought ways to ensure academic and…

Technological affordances have shown promising potential in advancing the delivery of corporate learning programmes designed for professional leadership development. However, there is a considerable challenge in evaluating learners' skill acquisition, with most of the past research relying on pre- and post-tests or other forms of self-reports to…

The purpose of this research was to evaluate the effect of item pool and selection algorithms on computerized classification testing (CCT) performance in terms of some classification evaluation metrics. For this purpose, 1000 examinees' response patterns using the R package were generated and eight item pools with 150, 300, 450, and 600 items…

Recent efforts to opt out of assessments have focused attention on the role that testing plays in accountability reforms in the United States. While opt-out activists often invoke the disproportionate impact of these reforms on communities of color, opting out has been more widespread in mostly White, affluent, and suburban communities. This study…