Since researchers investigated automatic scoring systems in writing assessments, they have dealt with relationships between human and machine scoring, and then have suggested evaluation criteria for inter-rater agreement. The main purpose of my study is to investigate the magnitudes of and relationships among indices for inter-rater agreement used…

The importance of functional adequacy as an essential component of L2 proficiency has been observed by several authors (Pallotti, 2009; De Jong, Steinel, Florijn, Schoonen, & Hulstijn, 2012a, b). The rationale underlying the present study is that the assessment of writing proficiency in L2 is not fully possible without taking into account the…

The purpose of the study was to investigate the effects of two comprehensive argumentative writing interventions--Text Structure Instruction (TSI) and Text Structure Revision Instruction (TSRI)--on the eighth-grade students' ability to compose convincing essays that include structural elements of argumentative discourse. Both treatment groups…

A corpus of 313 freshman college essays was analyzed in order to better understand the forms and functions of humor in academic writing. Human ratings of humor and wordplay were statistically aggregated using Factor Analysis to provide an overall "Humor" component score for each essay in the corpus. In addition, the essays were also…

Many students struggle with writing; however, curriculum-based measures (CBM) of writing often use assessment criteria that focus primarily on mechanics. When academic development is assessed in this way, more complex aspects of a student's writing, such as the expression and development of ideas, may be neglected. The current study was a…

This paper explored the effects of the amount of extensive reading (ER) on writing ability. Participants were 157 first and second-year non-English majors at a private university in Japan who took a writing test in class. Some of them were reading extensively, while others had no experience in ER. The outcomes of Pearson's correlation indicated…

The present study discusses the relevance of measures of lexical diversity (LD) to the assessment of learner corpora. It also argues that existing measures of LD, many of which have become specialized for use with language corpora, are fundamentally measures of lexical repetition, are based on an etic perspective of language, and lack construct…

The authors present a model for program-wide assessment of the effectiveness of writing instruction in a chemistry laboratory course. This model, which involves collaboration between faculty from chemistry, the Writing Across the Curriculum (WAC) program, and the Faculty Center for Teaching and Learning, is based on several theories and…

The present study aimed at characterizing what skilled or more proficient ESL college writing is in the Philippine setting through a contrastive analysis of three groups of variables identified from previous studies: resources, processes, and performance of ESL writers. Based on Chenoweth and Hayes' (2001; 2003) framework, the resource level…

Much research has investigated the role of planning time in second language writing; however, the results show that there are inconsistent findings about the effects of planning time conditions on the complexity of the EFL learners' textual output. The current study attempted to consider the differential effects of planning time conditions in…

This study is an attempt to investigate the effect of direct and indirect feedback on the writing performance of Iranian learners of Japanese as a foreign language. During one academic semester, three indirect feedback types including underlining, coding and translation were used as well as direct type of feedback in order to see which one makes a…

This study investigates the potential of a software tool based on Latent Semantic Analysis (LSA; Landauer, McNamara, Dennis, & Kintsch, 2007) to automatically evaluate complex German texts. A sample of N = 94 German university students provided written answers to questions that involved a high amount of analytical reasoning and evaluation.…

This paper describes a study comparing paper-based marking (PBM) and onscreen marking (OSM) in Hong Kong utilising English language essay scripts drawn from the live 2007 Hong Kong Certificate of Education Examination (HKCEE) Year 11 English Language Writing Paper. In the study, 30 raters from the 2007 HKCEE Writing Paper marked on paper 100…

Noting that improvement in rater reliability means eliminating differences among raters, this paper discusses ways to assess writing evaluator reliability and methods for achieving higher levels of interrater reliability. After showing that reliability can be improved two ways--by increasing the number of raters or measurements made, and by…

This study examined the difficulty level of essay topics used in the large-scale assessment of writing in relation to five different scoring models, and sought to determine what effects the scoring models would have on passing rates. In model one, examinee's score is the direct result of a score assigned by the reader or the sum of scores assigned…