Multistage adaptive testing (MST) has become popular in the testing industry because the research has shown that it combines the advantages of both linear tests and item-level computer adaptive testing (CAT). The previous research efforts primarily focused on MST design issues such as panel design, module length, test length, distribution of test…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the online delivery of the 2023 Elementary-Level (Grade 5) and Intermediate-Level (Grade 8) Science Computer-Based Field Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability…

Between 2018-2021, eight European medical schools took part in a study to develop a medical knowledge Online Adaptive International Progress Test. Here we discuss participants' self-perception to evaluate the acceptability of adaptive vs non-adaptive testing. Study participants, students from across Europe at all stages of undergraduate medical…

This article examines the risk of crossover contamination in individual-level randomization, a common concern in experimental research, in the context of a large-enrollment college course. While individual-level randomization is more efficient for assessing program effectiveness, it also increases the potential for control group students to cross…

This study investigated through an online survey how sign language practitioners changed their sign language assessment practices during the COVID-19 pandemic. The survey consisted of five sections and 29 questions overall. It was provided in written English and German as well as in International Sign and was administered online between October…

Over the last 20 years, many methods have been proposed to use process data (e.g., response time) to detect changes in engagement during the test-taking process. However, many of these methods were developed and evaluated in highly similar testing contexts: 30 or more single-select multiple-choice items presented in a linear, fixed sequence in…

Education of children with moderate to severe intellectual disabilities requires adequate assessment of their educational needs and potential to learn. Dynamic testing using analogical reasoning tasks may be a promising way to perform such an assessment. However, it remains unclear how dynamic testing with these children may be done in practice.…

Using classical test theory and item response theory, this study applied sequential procedures to a real operational item pool in a variable-length computerized adaptive testing (CAT) to detect items whose security may be compromised. Moreover, this study proposed a hybrid threshold approach to improve the detection power of the sequential…

The continuous testing framework, where both successful and unsuccessful examinees have to demonstrate continued proficiency at frequent prespecified intervals, is a framework that is used in noncognitive assessment and is gaining in popularity in cognitive assessment. Despite the rigorous advantages of this framework, this paper demonstrates that…

The appeal of a shorter testing time makes a computer adaptive testing approach highly desirable for use in multiple assessment and learning contexts. However, for those who have been tasked with designing, configuring, and deploying adaptive tests for operational use at scale, preparing an adaptive test is anything but simple. The process often…

Large-scale assessments often use a computer adaptive test (CAT) for selection of items and for scoring respondents. Such tests often assume a parametric form for the relationship between item responses and the underlying construct. Although semi- and nonparametric response functions could be used, there is scant research on their performance in a…

This study employed a quantitative research design to examine teacher assessment literacy and its relationship to external and internal factors. The researcher sought to describe the level of assessment literacy that teachers demonstrate when using score report data from computer-adaptive interim assessment and to analyze whether teachers'…

As an integral part of dynamic assessment, computerized dynamic assessment (CDA) offers learners computer-assisted automated mediation. Accordingly, the possible efficacy of corrective feedback seems to be enhanced with new technologies, such as artificial intelligence tools, that offer automatic corrective feedback. Using technology-enhanced…

High participation systems (HPS) of higher education (HE) are common throughout the world. The consequences of HE expansion has attracted enough academic attention; however, much less discussed is the impact of the HE expansion on retaking the college entrance examination. Drawing upon China's provincial panel data, a battery of econometric…

The Elementary and Secondary Education Act (ESEA), as amended by the Every Student Succeeds Act (ESSA), requires state education agencies to establish and implement standardized, statewide entrance and exit procedures for English learners (ELs). WIDA provides the English language proficiency placement and annual assessments administered in…