The ACTFL Oral Proficiency Interview--computer (OPIc) employs a self-assessment instrument to determine the nature of the speaking prompts to which the test taker will respond and, thus the difficulty of the test. Grounded in research demonstrating varying levels of accuracy in self-assessment among language learners, this study examines the…

This study sheds light on the relation between assessment modalities and student behavior through linguistics styles, and academic performance. First, we examine the effect of assessment modalities (self-evaluation quizzes and summative quizzes) on academic performance. Using two modalities of online quizzes, we mainly focus on the student…

The recent pandemic necessitated a migration to online instruction leading to concerns regarding the integrity of online assessments as a result of the presence of fee-based websites that disseminate answers to students. We validated this concern by evaluating student performance on an online quiz where some of the questions had easily searchable…

The internal validity of observational study is often subject to debate. In this study, we define the counterfactuals as the unobserved sample and intend to quantify its relationship with the null hypothesis statistical testing (NHST). We propose the probability of a robust inference for internal validity, that is, the PIV, as a robustness index…

Recently, adaptive test approaches have become a viable alternative to traditional fixed-item tests. The main advantage of adaptive tests is that they reach desired measurement precision with fewer items. However, fewer items mean that each item has a more significant effect on ability estimation and therefore those tests are open to more…

Item parameter drift (IPD) is the systematic differentiation of parameter values of items over time due to various reasons. If it occurs in computer adaptive tests (CAT), it causes errors in the estimation of item and ability parameters. Identification of the underlying conditions of this situation in CAT is important for estimating item and…

The Indiana Department of Education's (IDOE's) "Accessibility and Accommodations Information for Statewide Assessments" is intended for school-level personnel and decision-making teams as they prepare for and implement Indiana state assessments. Information is provided for school personnel as a reference to inform school personnel about…

Higher education and K-12 institutions have seen an increase in dual-credit participation for students with learning challenges. Given the rapid growth in the dual-credit programs and increasing numbers of students entering higher education institutions with learning challenges, more research was needed to support students in dual-credit programs…

The field of educational measurement places validity and fairness as central concepts of assessment quality (AERA, APA, NCME, 2014). Prior research has proposed embedding fairness arguments within argument-based validity processes, particularly when fairness is conceived as comparability in assessment properties across groups (Chapelle, 2021; Xi,…

As access to higher education increases, it is important to monitor students with special needs to facilitate the provision of appropriate resources and support. Although metrics such as ACT's (formerly American College Testing) "reading readiness" provide insight into how many students may need such resources, they do not specify…

The field of educational measurement places validity and fairness as central concepts of assessment quality. Prior research has proposed embedding fairness arguments within argument-based validity processes, particularly when fairness is conceived as comparability in assessment properties across groups. However, we argue that a more flexible…

Dyscalculia is a Specific Learning Disorder that affects ones' ability to comprehend, retain, and recall mathematical principles and basic facts. Approximately five million students in the United States have dyscalculia; these students are eligible to receive interventions and accommodations in math class. This study examined the efficacy of extra…

Many preschool agencies nationwide continue to experience closures and/or conversions to virtual or hybrid instruction due to the ongoing COVID-19 pandemic. Despite the importance of understanding young children's learning and development during the COVID emergency, limited knowledge exists on adaptable practices of assessing young children during…

This study investigated the effects of imposing task- or process-oriented reading behaviors on reading comprehension assessment performance. Students in grades 5-8 (N = 275) were randomly assigned to hear multiple-choice items read aloud before or after reading a test passage and when they were and were not allowed access to the passage while…

Research has found that the "a"-stratified item selection strategy (STR) for computerized adaptive tests (CATs) may lead to insufficient use of high a items at later stages of the tests and thus to reduced measurement precision. A refined approach, unequal item selection across strata (USTR), effectively improves test precision over the…