A frequently encountered security issue in writing tests is nonauthentic text submission: Test takers submit texts that are not their own but rather are copies of texts prepared by someone else. In this report, we propose AutoESD, a human-in-the-loop and automated system to detect nonauthentic texts for a large-scale writing tests, and report its…

This study delves into writing scores in both tests, aiming to uncover the reasons behind score differences. Through comprehensive comparative analysis, this research explores scoring patterns, criteria, and score distributions in IELTS and PTE writing sections. It investigates sources of score variation, including task design, rating criteria,…

The extent to which writing modality (i.e., hand-writing vs. keyboarding) impacts second-language (L2) writing assessment scores remains unclear. For alphabetic languages like English, research shows mixed results, documenting both equivalent and divergent scores between typed and handwritten tests (e.g., Barkaoui & Knouzi, 2018). However, for…

Lexical diversity (LD) is an important indicator of second language lexical development. Much research has investigated LD indices, with a focus on learners of English. However, further research is needed in languages that are typologically distinct from English, such as Korean. In this study, we evaluated the reliability and validity of LD…

The present study explored the effects of interactionist Dynamic Assessment (DA) and age on the writing accuracy of IELTS candidates. This research investigated the existence of an interactional effect between the age of learners and the type of treatment they received. First, 140 IELTS candidates were split into two age groups, adult and young.…

Students with emotional and behavioral challenges often struggle with writing. Curriculum-based measurement (CBM) is an assessment used for a variety of purposes including screening, progress monitoring, and data-based individualization. However, little research has examined technical properties of writing CBM data and supported inferences. This…

Cognitive diagnostic assessment (CDA) intends to identify learners' strengths and weaknesses in latent cognitive attributes to provide personalized remedial instructions. Previous CDA studies on English as a Foreign Language (EFL)/English as a Second Language (ESL) writing have adopted dichotomous cognitive diagnostic models (CDMs) to analyze data…

Assessing the content of learners' compositions is a common practice in second language (L2) writing assessment. However, the construct definition of content in L2 writing assessment potentially underrepresents the target competence in content and language integrated learning (CLIL), which aims to foster not only L2 proficiency but also critical…

While many studies have addressed the benefits of technology-assisted L2 writing, limited research has delved into how generative artificial intelligence (GAI) supports students in completing their writing tasks in Mandarin Chinese. In this study, 26 university-level Mandarin Chinese foreign language students completed two writing tasks on two…

In this Brief Report, we describe an evaluation of and revisions to a rubric adapted from the Jacobs et al.'s (1981) ESL COMPOSITION PROFILE, with four rubric categories and 20-point rating scales, in the context of an intensive English program writing placement test. Analysis of 4 years of rating data (2016-2021, including 434 essays) using…

There now exists an established body of work outlining the challenges international students can face as part of the acculturation process, including a range of academic and non-academic pressures to overcome. For many students, writing essays in academic English for the first time is problematic. This article considers pedagogical approaches for…

The purpose of this study was to examine the effectiveness of explicit corrective feedback (CF) strategies (i.e., metalinguistic feedback and explicit correction) versus implicit CF methods (i.e., recasts and explanation questions) in helping English language learners acquire the that-trace filter. To this end, one hundred twenty intermediate…

Vocabulary knowledge plays an important role in writing. Previous research has examined the relationship between various aspects of vocabulary knowledge and independent writing performance and limited attention has been given to integrated writing such as summary writing. Our study investigated the contribution of two aspects of vocabulary…

This study employed a multi-methods design to investigate the impact of preparation on Chinese test-takers' perceptions of the integrated TOEFL iBT speaking and writing design. Combining results from over 1700 surveys and 10 interviews, it was found that these Chinese test-takers, who are the most vulnerable group in the multimillion testing…

Language assessment literacy has emerged as an important area of research within the field of language testing and assessment, garnering increasing scholarly attention. However, the existing literature on language assessment literacy primarily focuses on teachers and administrators, while students, who sit at the heart of any assessment, are…