In this research report, we describe the design and empirical findings for a large-scale study of essay writing ability with approximately 2,500 high school students in Germany and Switzerland on the basis of 2 tasks with 2 associated prompts, each from a standardized writing assessment whose scoring involved both human and automated components.…

Many assessments of writing proficiency that aid in making high-stakes decisions consist of several essay tasks evaluated by a combination of human holistic scores and computer-generated scores for essay features such as the rate of grammatical errors per word. Under typical conditions, a summary writing score is provided by a linear combination…

Threats to construct validity should be reduced to a minimum. If true, sources of bias, namely raters, items, tests as well as gender, age, race, language background, culture, and socio-economic status need to be spotted and removed. This study investigates raters' experience, language background, and the choice of essay prompt as potential…

L2 writers likely perceive "good academic writing" as impersonal (Hyland, 2002; Shen, 1989; Tang & John, 1999). Yet research has shown that every linguistic and rhetorical choice that a writer makes--including, the presence/absence and different forms of self-mention--potentially reveals the writer's authorial identity (Ivanic,…

Under the framework of item response theory (IRT) and generalizability (G-) theory, this study examined the effects of item difficulty on rating reliability and construct validity on both the constructed-response (CR) items and essay items on English examinations. The data collected for this study were students' scores and responses on the two…

Professor Shirley Alexander is the Deputy Vice-Chancellor and Vice-President (Teaching, Learning & Equity) at the University of Technology, Sydney. On 12 November 2014, an article of hers appeared in "The Conversation": "Buying essays: how to make sure assessment is authentic." That article traverses, in an abbreviated way,…

This study investigates how newcomers to the university setting integrate lexical bundles (LBs)--frequently recurring word sequences--into their writing by analyzing the bundles' "syntactic roles" (i.e., relations to larger structures). Previous studies have considered phrases and clauses as the main internal structures of LBs; however,…

Writing studies scholarship has long understood the need for context-based studies of student writing. Few studies, however, have closely examined how students use intertextual relationships in the context of learning to compose argumentative essays. Drawing on a 17-day argumentative writing unit in a ninth-grade humanities classroom, this article…

Peer-feedback efficiency might be influenced by the oftentimes voiced concern of students that they perceive their peers' competence to provide feedback as inadequate. Feedback literature also identifies mindful processing of (peer)feedback and (peer)feedback content as important for its efficiency, but lacks systematic investigation. In a 2 × 2…

Previous corpus research on English for academic purposes (EAP) writing has analyzed how often additional language (L2) writers use words from the Academic Word List (AWL) (Coxhead, 2000), but few studies to date have explored how accurately those words are used. Therefore, the current study investigated how accurately and appropriately EAP…

This study compares a problem-solving account of discovery through writing, which attributes discovery to strategic rhetorical planning and assumes discovery is associated with better quality text, to a dual-process account, which attributes discovery to the combined effect of 2 conflicting processes with opposing relationships to text quality.…

Syntactic complexity is an important measure of second language (L2) writing proficiency (Larsen--Freeman, 1978; Lu, 2011). Large-grained indices such as the mean length of T-unit (MLTU) have been used with the most consistency in L2 writing studies (Ortega, 2003). Recently, indices such as MLTU have been criticized, both for the difficulty in…

The current study explored relations between non-cognitive traits (Grit, Learning Orientation, Performance Orientation), reading skill, and performance across three experiments conducted in the context of two intelligent tutoring systems, iSTART and Writing Pal. Results showed that learning outcomes (comprehension score, holistic essay score) were…

Self-directed learning among students, particularly at the upper secondary level, is still underexplored in Malaysia. Further understanding of ESL students' readiness for self-directed learning in improving English writing skills is crucial to exploit the advantages of this learning method for their benefit. Thus, this study aimed to examine the…

The major purpose of this study is to investigate the impact of flipped classroom on pre-service English teachers' Advanced Writing achievement. The study also aims at exploring whether flipped classroom approach makes a difference, if any, on the self-regulated learning of the participants. The participants of this study were selected by…