Despite the increasing interest in using AI tools as assistant agents in instructional settings, the effectiveness of ChatGPT, the generative pretrained AI, for evaluating the accuracy of second language (L2) writing has been largely unexplored in formative assessment. Therefore, the current study aims to examine how ChatGPT, as an evaluator,…

Establishing a cut score is a crucial aspect of the test development process since the selected cut score has the potential to impact students' performance outcomes and shape instructional strategies within the classroom. Therefore, it is vital for those involved in test development to set a cut score that is both fair and justifiable. This cut…

Testing is an effective method to determine learning outcomes for knowledge and skills learning domains. The aim of this study was to examine the differences in test achievements among 50 Saudi female English major students at the College of Languages at Princess Nourah University in Riyadh. The tests were administered using two different methods:…

This research presents a novel reading fluency (rf) measurement formula that accounts for both reading rate and comprehension. Possible formulas were investigated with 68 participants in a strategic reading course in an IEP at a small Pacific Island university. The selected formula's scores demonstrated concurrent validity through strong…

Chiang Mai Rajabhat University Test of English Proficiency (CMRU-TEP) is a required English proficiency test for all CMRU students before graduation. Despite its meticulous design, there is an opportunity for students to improve their scores through focused efforts and targeted support. This study employs an explanatory sequential mixed-methods…

The extent to which writing modality (i.e., hand-writing vs. keyboarding) impacts second-language (L2) writing assessment scores remains unclear. For alphabetic languages like English, research shows mixed results, documenting both equivalent and divergent scores between typed and handwritten tests (e.g., Barkaoui & Knouzi, 2018). However, for…

Testing can potentiate new learning, which is often called the "forward testing effect." One potential explanation for this benefit is that testing might enable participants to use more effective learning strategies subsequently. We investigated this possibility by asking participants to report their encoding strategies in a multi-list…

Automated corrective feedback (ACF), in which a computer system helps language learners identify and correct errors in their writing or speech, is considered an important tool for language instruction by many researchers. Such systems allow learners to correct their own mistakes, thereby reducing teacher workload and potentially preventing issues…

This study aims to disclose the Iranian university teachers' perceptions of the fundamentals of language assessment literacy (LAL). To this aim, using purposive sampling, eighteen university teachers from two Iranian universities were invited to participate in semi-structured interviews. Their viewpoints were audio-recorded, transcribed, and…

Local item dependence (LID) refers to the situation where responses to items in a test or questionnaire are influenced by responses to other items in the test. This could be due to shared prompts, item content similarity, and deficiencies in item construction. LID due to a shared prompt is highly probable in cloze tests where items are nested…

The present study aimed to determine the effects of a computerized dynamic reading assessment (CDRA) program on English reading comprehension of university students with a lower level of English proficiency. Fulcher's (2003) framework was adapted in program development divided into three phases: program development, program implementation, and…

Studies on washback of not only international standardized proficiency tests, but also localized high-stakes tests have been increasingly attracting considerable interest. The current study explores the washback effects of a Vietnam-made localized English proficiency test named "Vietnamese Standardized Test of English Proficiency, level…

In this paper, we investigated the impact of an online classroom-based reading assessment on implementing practices in reading instruction among 30 EFL learners in an intermediate reading course at a public university in East Java, Indonesia. Our study aimed to develop an online classroom-based reading assessment and evaluate its efficacy in…

The online placement test for the Community English Language Program (CLP) at Teachers College, Columbia University has been administered in a computer lab since 2015. While most of the components of this placement exam system are online, including registration, exam delivery, scoring, and score reporting, the COVID-19 pandemic elevated the need…

The present study aims to explore how second language (L2) speakers process four types of presupposition triggers in an online self-paced reading task and an offline acceptability judgment task. The four types of triggers are definite expressions with "the," the factive verb "know," the change-of-state verb "stop" and…