In rural Mississippi, addressing the issue of reading nonproficiency for third-grade students has posed a significant challenge. To tackle the issue's complexity, the Mississippi legislature implemented the Literacy-Based Promotion Act (LBPA), also known as the 'no social promotion grade-level retention gateway" (Barrett-Tatum et al., 2019).…

The emergence of digital-first assessments is prompting reconsideration of, and innovation in, aspects of psychometrics, test validation, and test use. Using the Duolingo English Test (DET) as an example, this three-paper series seeks to address issues concerning the estimation of classification consistency and the reporting of results for such…

Automated assessment using Natural Language Processing (NLP) has the potential to make English speaking assessments more reliable, authentic, and accessible. Yet without careful examination, NLP may exacerbate social prejudices based on gender or native language (L1). Current NLP-based assessments are prone to such biases, yet research and…

Pragmatic competence has been increasingly recognized as a component of academic language proficiency assessment (Youn, 2018). However, the practicality of administering L2 pragmatic competence assessments involving interlocutors remains problematic (e.g., high labor cost) (Ikeda, 2017). The pandemic makes it even more difficult to administer…

The digital transformation in educational assessment has led to the proliferation of large-scale data, offering unprecedented opportunities to enhance language learning, and testing through machine learning (ML) techniques. Drawing on the extensive data generated by online English language assessments, this dissertation investigates the efficacy…

Millions of public-school students in the United States are identified as English language learners (ELLs), whose academic success is tied to their second language (L2) English education. Previous research in adult populations indicates that L2 proficiency is related to the contextual variable of the prevalence of one's first language (L1) among…

With the wide introduction of English-medium instruction (EMI) to higher education institutions throughout East Asian countries, many East Asian universities are using English proficiency tests that were not originally designed for this context to make admissions and placement decisions. To support the use of these tests in this new EMI context,…

Despite an emphasis on oral communication in most foreign language classrooms, the resource-intensive nature (i.e. time and manpower) of speaking tests hinder regular oral assessments. A possible solution is the development of a (semi-) automated scoring system. When it is used in conjunction with human raters, the consistency of computers can…

Vocabulary researchers have started expanding their assessment toolbox by incorporating timed tasks and psycholinguistic instruments (e.g., priming tasks) to gain insights into lexical development (e.g., Elgort, 2011; Godfroid, 2020b; Nakata & Elgort, 2020; Vandenberghe et al., 2021). These timed sensitive and implicit word measures differ…

With over one million emergent bilinguals enrolled in Texas public schools, a call to action and a review of high-stakes online assessment policy for this student population is essential to achieve equity in education. The purpose of this phenomenological study aimed to explore teachers' perceptions of high-stakes online TELPAS testing and digital…

The assessment of oral proficiency in English for Specific Purposes (ESP) contexts remains a central challenge for researchers, test developers, and classroom teachers (Knoch & Macqueen, 2020). This problem is apparent especially in Tourism and Hotel Management (THM) programs, where students are tested mostly based on grammar, vocabulary, and…

While recent research has shown that multimodal feedback and use of formulaic sequences (FS) are effective in improving student performance on writing tasks, there is a dearth of studies on the impact of these aspects on computer-based academic speaking assessments. This dissertation seeks to fill this gap by examining the impact of both…

The heightened importance of foreign languages (L2) in the post 9-11 world demands more L2 listening research as listening is considered the most critical skill for most American military linguists. Some larger studies show that lexical knowledge can positively affect L2 listening (Chang, 2007; Mehrpour & Rahimi, 2010; Staehr, 2009), yet…

Latinx dual language learners (DLLs) are an enormous and growing student body that faces educational adversities and inequities. One of the most salient findings to emerge from decades of educational research is that DLLs who close the gap with their monolingual peers and have the best long-term academic performance are those who develop strong…

The purpose of this sequential mixed method study was to determine if there were differences between central office administrators', school administrators', and bilingual and English as a second language (ESL) teachers' overall and levels of action, self-regulation, and means efficacies, when controlling for years of experience with bilingual and…