Online learning systems should support students preparedness for professional practice by equipping them with the necessary skills while keeping them engaged and active. In that regard, the development of online learning systems that support students' development and engagement with programming is a challenging process. Early career computer…

Accompanying the still pervasive influence of the College English Test (CET), some universities in China, especially the higher-ranking ones, have in recent years devised and implemented their own local English testing regimes. This significant shift, however, has captured limited research attention. Building on considerations in local language…

The COVID-19 pandemic outbreak has upended the educational system worldwide, possibly with severe long-term consequences as most training institutions were forced to move to an online environment. Given the sudden transition to remote education, the main objective of this contribution is to evaluate the impact of distance education on examination…

Background: It is important for institutions of higher education to maintain academic integrity, both for students and the institutions themselves. Proctoring is one way of accomplishing this, and with the increasing popularity of online courses--along with the sudden shift to online education sparked by the COVID-19 pandemic--digital proctoring…

Computer-based and web-based testing have become increasingly popular in recent years. Their popularity has dramatically expanded the availability of response time data. Compared to the conventional item response data that are often dichotomous or polytomous, response time has the advantage of being continuous and can be collected in an…

The ACTFL Oral Proficiency Interview--computer (OPIc) employs a self-assessment instrument to determine the nature of the speaking prompts to which the test taker will respond and, thus the difficulty of the test. Grounded in research demonstrating varying levels of accuracy in self-assessment among language learners, this study examines the…

This study sheds light on the relation between assessment modalities and student behavior through linguistics styles, and academic performance. First, we examine the effect of assessment modalities (self-evaluation quizzes and summative quizzes) on academic performance. Using two modalities of online quizzes, we mainly focus on the student…

The recent pandemic necessitated a migration to online instruction leading to concerns regarding the integrity of online assessments as a result of the presence of fee-based websites that disseminate answers to students. We validated this concern by evaluating student performance on an online quiz where some of the questions had easily searchable…

The internal validity of observational study is often subject to debate. In this study, we define the counterfactuals as the unobserved sample and intend to quantify its relationship with the null hypothesis statistical testing (NHST). We propose the probability of a robust inference for internal validity, that is, the PIV, as a robustness index…

Recently, adaptive test approaches have become a viable alternative to traditional fixed-item tests. The main advantage of adaptive tests is that they reach desired measurement precision with fewer items. However, fewer items mean that each item has a more significant effect on ability estimation and therefore those tests are open to more…

Item parameter drift (IPD) is the systematic differentiation of parameter values of items over time due to various reasons. If it occurs in computer adaptive tests (CAT), it causes errors in the estimation of item and ability parameters. Identification of the underlying conditions of this situation in CAT is important for estimating item and…

The Indiana Department of Education's (IDOE's) "Accessibility and Accommodations Information for Statewide Assessments" is intended for school-level personnel and decision-making teams as they prepare for and implement Indiana state assessments. Information is provided for school personnel as a reference to inform school personnel about…

Higher education and K-12 institutions have seen an increase in dual-credit participation for students with learning challenges. Given the rapid growth in the dual-credit programs and increasing numbers of students entering higher education institutions with learning challenges, more research was needed to support students in dual-credit programs…

The field of educational measurement places validity and fairness as central concepts of assessment quality (AERA, APA, NCME, 2014). Prior research has proposed embedding fairness arguments within argument-based validity processes, particularly when fairness is conceived as comparability in assessment properties across groups (Chapelle, 2021; Xi,…

As access to higher education increases, it is important to monitor students with special needs to facilitate the provision of appropriate resources and support. Although metrics such as ACT's (formerly American College Testing) "reading readiness" provide insight into how many students may need such resources, they do not specify…