The study highlights ChatGPT-4's potential in educational settings for the evaluation of university students' open-ended written examination responses. ChatGPT-4 evaluated 54 written responses, ranging from 24 to 256 words in English. It assessed each response using five criteria and assigned a grade on a six-point scale from fail to excellent,…

Assessing the content of learners' compositions is a common practice in second language (L2) writing assessment. However, the construct definition of content in L2 writing assessment potentially underrepresents the target competence in content and language integrated learning (CLIL), which aims to foster not only L2 proficiency but also critical…

Existing approaches to measuring writing performance are insufficient in terms of both technical adequacy as well as feasibility for use as a screening measure. This study examined the validity and diagnostic accuracy of several approaches to automated text evaluation as well as written expression curriculum-based measurement (WE-CBM) to determine…

Existing approaches to measuring writing performance are insufficient in terms of both technical adequacy as well as feasibility for use as a screening measure. This study examined the validity and diagnostic accuracy of several approaches to automated text evaluation as well as written expression curriculum-based measurement (WE-CBM) to determine…

Writing assessment literacy (WAL) has received research attention over the past few years. This study aimed at investigating writing assessment knowledge of Iranian English language teachers along with their conceptions and practices of writing assessment based on Crusan et al.'s (Assessing Writing 28:43-56, 2016) study in order to have a better…

Automated writing evaluation (AWE) software is an increasingly popular tool for English second language learners. However, research on the accuracy of such software has been both scarce and largely limited in its scope. As such, this article broadens the field of research on AWE accuracy by using a mixed design to holistically evaluate the…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

Written expression curriculum-based measurement (WE-CBM) is a formative assessment approach for screening and progress monitoring. To extend evaluation of WE-CBM, we compared hand-calculated and automated scoring approaches in relation to the number of screening samples needed per student for valid scores, the long-term predictive validity and…

Written expression curriculum-based measurement (WE-CBM) is a formative assessment approach for screening and progress monitoring. To extend evaluation of WE-CBM, we compared hand-calculated and automated scoring approaches in relation to the number of screening samples needed per student for valid scores, the long-term predictive validity and…

Researchers frequently evaluate rater judgments in performance assessments for evidence of differential rater functioning (DRF), which occurs when rater severity is systematically related to construct-irrelevant student characteristics after controlling for student achievement levels. However, researchers have observed that methods for detecting…

The purpose of the current dissertation is to map the relationships between first language (L1), writing quality, and syntactic complexity, accuracy, lexical complexity, and fluency (CALF) in second language (L2) writing. CALF are characteristics of language production that have been of significant interest in L2 writing research for the past few…

We examined the classification accuracy of Curriculum-Based Measurement in writing (CBM-W) Picture Word prompts scored for words written (WW), words spelled correctly (WSC), and correct word sequences (CWS). First graders (n = 133) were administered CBM-W prompts and the Test of Written Language-Third Edition (TOWL-3; Hammill & Larsen, 1996).…

Many assessments of writing proficiency that aid in making high-stakes decisions consist of several essay tasks evaluated by a combination of human holistic scores and computer-generated scores for essay features such as the rate of grammatical errors per word. Under typical conditions, a summary writing score is provided by a linear combination…

This study investigated the effects of strategic planning and task structure (personal, narrative, and decision-making tasks) on L2 writing outcomes. One hundred and twenty intermediate English as a foreign language learners were randomly divided into strategic-planning and no-planning-time groups. The strategic-planning group performed the three…

The present study was an attempt to investigate the differential effect/s of three different planning time scenarios (i.e. 0 min, 10 min, & 20 min), as well as three task conditions of (1) topic given, (2) topic and ideas given, and (3) topic, ideas and macrostructure given on EFL learners L2 writing complexity, accuracy and fluency (CAF).…