There is a vast body of literature documenting the positive impacts that rater training and calibration sessions have on inter-rater reliability as research indicates several factors including frequency and timing play crucial roles towards ensuring inter-rater reliability. Additionally, increasing amounts research indicate possible links in…

The 2022-2023 Indiana Assessments Policy Manual serves as the foundation for established guidelines regarding appropriate test administration in Indiana for key stakeholders including educators and Test Coordinators. The following document contains policy guidance and contains appendices which pertain to specific aspects of test implementation,…

J.D. Brown (JD) served as the author of an instructional column titled "Statistics Corner" in the "Shiken": JALT "Testing & Evaluation SIG Newsletter" for an extensive period spanning over two decades, from 1997 to 2019. This publication was under the auspices of the Testing and Evaluation Special Interest Group,…

Two-stage testing is a form of collaborative assessment that creates an active learning environment during test taking. In two-stage testing, students first complete an exam individually, and then complete a subset of the same questions as part of a learning team with the ultimate exam score being a weighted average of the individual and team…

Computer-assisted language assessment literacy (LAL) has gained momentum in English as a foreign language (EFL) teaching since computer-based education became particularly common in language education. As EFL teachers play a critical role in administering computer-assisted language assessments, Iranian EFL teachers need to learn, relearn, and…

The "2021-2022 WIDA Assessment Guidance" provides information on the following 14 topics: (1) English Language Proficiency Requirements; (2) Participation Requirements; (3) WIDA Assessments in Grades K-12; (4) WIDA ACCESS Annual Assessments Test Window; (5) Indiana English Learner Entrance and Exit Criteria; (6) Scheduling and Timing…

This systematic review investigated the topics studied and reporting practices of published meta-analyses in educational measurement. Our findings indicated that meta-analysis is not a highly utilized methodological tool in educational measurement; on average, less than one meta-analysis has been published per year over the past 30 years (28…

Mathematical modeling describes how events, concepts, and systems of interest behave in the world using mathematical concepts. This research approach can be applied to theory construction and testing by using empirical data to evaluate whether the specific theory can explain the empirical data or whether the theory fits the data available.…

The testing effect occurs when a person's memory performance is enhanced by previous tests. The current studies examined the performance effects of a classroom testing procedure on high and low performing students and their transfer of learning. Hypotheses: We predicted testing in the classroom would lead to a testing effect and transfer of…

Subtle instructional changes that direct attentional focus can lead to changes in performance, potentially hindering a fitness assessment. An external attentional focus has been found to improve motor performance, however less is known about instructional effects on performance and the physiological response during an isometric endurance test. To…

This article explores the implementation of an online high-stakes language proficiency test during the COVID-19 pandemic through a narrative inquiry of a test-designer, Eda (pseudonym). Situated in the context of Turkish higher education, this study examines Eda's narrative accounts with regard to the development of test adaptation and…

Gaining knowledge of statistics is important in most (under)graduate programs within the social and behavioral sciences and requires repeated study by students, highlighting the need for good practice materials. We describe the development of an open item bank of statistics exercises by a community of instructors from Dutch universities: the…

This paper aims to map and understand tactics and practices of resistance to standardised testing in England by focusing on the "More Than a Score" (MTAS) campaign. More specifically, this paper examines the role of professional organisations affiliated to the MTAS campaign in the production and mobilisation of expert knowledge as a tool…

Online misinformation is a pervasive global problem. In response, psychologists have recently explored the theory of psychological inoculation: If people are preemptively exposed to a weakened version of a misinformation technique, they can build up cognitive resistance. This study addresses two unanswered methodological questions about a widely…

This study investigates unproctored assignment-based assessment implementation in an online teaching environment compared to on-site assessment. A mixed-method research approach was conducted with the participation of 284 English-major students, 6 teachers, and 4 experts at a university in Vietnam. Data collection instruments included a…