This report describes a calibration, scoring, and reporting method applicable to an assessment requiring aggregation at multiple levels. We demonstrate the method using an example of an assessment that targets a small and diverse population, an English language proficiency assessment for English learners with the most significant cognitive…

Background: Early-grade reading proficiency is well documented as in important factor for later academic success. Researchers and educators consider the achievement of reading proficiency by the end of grade three to be crucial to future academic success and financial independence (Hein et al., 2013; La Paro & Pianta, 2000; Singh, 2013). As…

This paper reports partial results from a larger study of how three different groups of stakeholders--university admissions officers, faculty in graduate programs involved in admissions decisions, and Intensive English Program (IEP) faculty--interpret and use TOEFL iBT® scores in making admissions decisions or preparing students to meet minimum…

Local item dependency (LID) occurs when test-takers' responses to one test item are affected by their responses to another. It can be problematic if it causes inflated reliability estimates or distorted person and item measures. The cued-recall reading comprehension test in Hu and Nation's (2000) well-known and influential coverage--comprehension…

A feature of the presented study is a comprehensive approach to studying the reliability problem of linguistic testing results due to the several functional and variable factors impact. Contradictions and ambiguous views of scientists on the researched issues determine the relevance of this study. The article highlights the problem of equivalence…

Testing English writing skills could be multi-dimensional; thus, the study aimed to compare students' writing scores calculated according to Classical Test Theory (CTT) and Multi-Facet Rasch Model (MFRM). The research was carried out in 2019 with 100 university students studying at a foreign language preparatory class and four experienced…

There has been controversy around the practice of providing accommodations, with some suggesting that they may give an unfair advantage rather than level the playing field. If that were the case, the assessment results of students with accommodations could be inflated, leading to a detrimental effect on the assessment's validity. This research…

As testing programs transition from paper to online testing, they must study mode comparability to support the exchangeability of scores from different testing modes. To that end, a series of three mode comparability studies was conducted during the 2019-2020 academic year with examinees randomly assigned to take the ACT college admissions exam on…

The roles of grammar in the teaching of English as a foreign language (EFL) have long been discussed. This study explored viewpoints of five categories of local stakeholders regarding the roles of grammar in the Thai EFL context. Questionnaires were administered to two groups of Thai university students, and focus-group and semi-structured…

Applied linguists have increasingly focused on how the lives of English language teachers and learners are shaped by race and its intersections with other marginalized identities (e.g. Von Esch et al, 2020). Curiously overlooked, however, are the experiences of one particularly stigmatized group in English-majority countries: Muslim women veiled…

Young learners' language aptitude is understudied due to a lack of tests covering this period of life. Young learners, in contrast with adults, are still acquiring their L1. Consequently, a language-dependent aptitude test should be carefully designed for it to be valid. An additional challenge is found when the young learners who are to take the…

Purpose: We examined whether diverse profiles of strengths and weaknesses would emerge when assessing different aspects of morphological awareness in first- through sixth-grade students using a recently developed standardized test, the Morphological Awareness Test for Reading and Spelling (MATRS; Apel et al., 2021). Method: Four thousand…

This paper represents a summary and discussion of the three studies presented at the morning session of the Fall 2022 JALT Vocabulary SIG. The papers, which were written by Ali Al-Hoorie, Masaki Eguchi, Derek Canning, Stuart McLean, Christopher Nicklin, and Joseph Vitta, represent a range of topics and study designs that are common in recent…

The purpose of this quantitative correlational study was to determine if and to what extent an ELL student's SBELP-RC could predict his or her ACPELA-RC, ACPELA-WP, and ACP-A1. Study participants were ELL students in Grades 9 to 12, attending a Northern Virginia high school. A further purpose of this study was to investigate if and to what extent…

Purpose: This study examined the effect of phonological overlap on English and Spanish expressive vocabulary accuracy as measured by the bilingual Expressive One-Word Picture Vocabulary Test--Fourth Edition (EOWPVT-IV). We hypothesized that if languages interact during an expressive vocabulary task, then higher phonological overlap will predict…