Background/Context: Regression discontinuity (RD) designs are used for policy and program evaluation where subjects' eligibility into a program or policy is determined by whether an assignment variable (i.e., running variable) exceeds a pre-defined cutoff. Under a standard RD design with a continuous assignment variable, the average treatment…

The spread of academic testing for accountability purposes in multiple countries has obscured at least two historical purposes of academic testing: community ritual and management of the social structure. Testing for accountability is very different from the purpose of academic challenges one can identify in community "examinations" in…

This study employed a blended learning approach to investigate 98 medical university EFL students' perceptions and analyzed the learning trajectory of their LMOOCs in formal education. Meanwhile, Byram's (1997) intercultural communicative competence (ICC) model was adopted to explore if students' English proficiency and ICC abilities could enhance…

Language proficiency testing serves an important function of classifying examinees into different categories of ability. However, misclassification is to some extent inevitable and may have important consequences for stakeholders. Recent research suggests that classification efficacy may be enhanced substantially using computerized adaptive…

Improving perceptions of graduate utility is fundamental to Higher Education's employability and skills agenda. However, utility enhancement is a ubiquitous consequence of all learning. Therefore, motivating students to engage in deep learning to improve their utility is problematic. Using the student voice, in this article, I explain how prompts…

Modular systems, which involve several self-contained modules where skills and knowledge are developed in separate units throughout the program, are gaining popularity in teaching English as a foreign language (EFL). This qualitative study aimed to reveal language instructors' and administrators' experiences and opinions about an online modular…

L2 pragmatics have explored the effects of different factors on different aspects of learners' pragmatic performance, but often not simultaneously. In addition, syntactic complexity is rarely examined in L2 pragmatics. This cross-sectional study aimed to conduct a multidimensional analysis to explore the effects of proficiency and study-abroad…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on ELA achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) ELA assessment. This study compared the ELA achievement growth in the 2020-21 school year of students who…

A multiple testing method for examining factorial invariance for latent constructs evaluated by multiple indicators in distinct populations is outlined. The procedure is based on the false discovery rate concept and multiple individual restriction tests and resolves general limitations of a popular factorial invariance testing approach. The…

The development of statistical methods for detecting test collusion is a new research direction in the area of test security. Test collusion may be described as large-scale sharing of test materials, including answers to test items. Current methods of detecting test collusion are based on statistics also used in answer-copying detection.…

Variable-length computerized adaptive testing (VL-CAT) allows both items and test length to be "tailored" to examinees, thereby achieving the measurement goal (e.g., scoring precision or classification) with as few items as possible. Several popular test termination rules depend on the standard error of the ability estimate, which in turn depends…

The purpose of this study is to evaluate the performance of CATSIB (Computer Adaptive Testing-Simultaneous Item Bias Test) for detecting differential item functioning (DIF) when items in the matching and studied subtest are administered adaptively in the context of a realistic multi-stage adaptive test (MST). MST was simulated using a 4-item…

As validity pertains to test use rather than the test itself, using a test for unintended purposes requires a new validation program using additional evidence from relevant sources. This small-scale study contributes to the validation of the use of originally academic language tests--the International English Language Testing System and the Test…

There has been an ongoing debate of which physical labs or virtual labs are better. To resolve this issue, a remote lab provides an online lab that can do real experiments to obtain real data from a distant physical lab. Instead of relying on a remote lab, this article suggests that students collect experimental data locally with low-cost data…

This study reports on the goal structures of one rural and one urban Grade 11 class in China, based on classroom observations and teacher and student interviews. Classroom observations, conducted over a 6-month period, focused on physical settings and classroom activities. In each class, seven students and the homeroom teacher were interviewed to…