Since researchers investigated automatic scoring systems in writing assessments, they have dealt with relationships between human and machine scoring, and then have suggested evaluation criteria for inter-rater agreement. The main purpose of my study is to investigate the magnitudes of and relationships among indices for inter-rater agreement used…

Writing essays and receiving feedback can be useful for fostering students' learning and motivation. When faced with large class sizes, it is desirable to identify students who might particularly benefit from feedback. In this article, we tested the potential of Latent Semantic Analysis (LSA) for identifying poor essays. A total of 14 teaching…

Previous research suggests that audio feedback may be an important mechanism for facilitating effective and timely assignment feedback. The present study examined expectations and experiences of audio and written feedback provided through "turnitin for iPad®" from students within the same cohort and assignment. The results showed that…

In this research, we investigated the feasibility of implementing the "e-rater"® scoring engine as a check score in place of all-human scoring for the "Graduate Record Examinations"® ("GRE"®) revised General Test (rGRE) Analytical Writing measure. This report provides the scientific basis for the use of e-rater as a…

This study addresses the current debate about the beneficial effects of text processing software on students with different working memory (WM) during the process of academic writing, especially with regard to the ability to display higher-level conceptual thinking. A total of 54 graduate students (15 male, 39 female) wrote one essay by hand and…

Classroom teachers sometimes struggle trying to find time during the typical school day to provide the writing instruction students need to be successful. This study examined 29 fifth through twelfth grade classroom teachers' survey responses about their perception of the effectiveness of using an online blogging tool, Kidblog, to plan and provide…

Expressing causal relations plays a central role in academic writing. While it is important that writing instructors assess and provide feedback on learners' causal discourse, it could be a very time-consuming task. In this respect, automated writing evaluation (AWE) tools may be helpful. However, to date, there have been no AWE tools capable of…

This research paper aims to explore the usage of the English Auxiliary "Be" Present Tense Verb, using corpus based method among Malaysian form 4 and form 5 students. This study is conducted by identifying and classifying the types of errors in the Auxiliary "Be" Present Tense verb in students' compositions from the MCSAW corpus…

The study explored whether aspects of elementary students' writing about their personal values could predict if students were considered more at risk or more resilient. Essays from 176 fifth-grade students (79.54% African American, 20.46% Hispanic) from a low-income, urban district in New Jersey were analyzed using the Linguistic Inquiry and Word…

This study addresses research gaps in predicting second language (L2) writing proficiency using linguistic features. Key to this analysis is the inclusion of linguistic measures at the surface, textbase and situation model level that assess text cohesion and linguistic sophistication. The results of this study demonstrate that five variables…

Scoring models for the "e-rater"® system were built and evaluated for the "TOEFL"® exam's independent and integrated writing prompts. Prompt-specific and generic scoring models were built, and evaluation statistics, such as weighted kappas, Pearson correlations, standardized differences in mean scores, and correlations with…

The error-correction program "Criterion" provides students with an immediate essay feedback using tools that can analyze and review writing automatically. This feedback covers grammar, usage, mechanics, style, organization, and development. With its diagnostic tools for scoring essays and offering relevant feedback, the error-correction…

This study investigates the potential of a software tool based on Latent Semantic Analysis (LSA; Landauer, McNamara, Dennis, & Kintsch, 2007) to automatically evaluate complex German texts. A sample of N = 94 German university students provided written answers to questions that involved a high amount of analytical reasoning and evaluation.…

Computer-based writing is already a norm to a large extent in social communication for any major language around the world. From this perspective, it would be pedagogically sound for students to master the Chinese input system as early as possible. This poses some challenges to students in Singapore, most of which are learning Chinese as a second…

The main purpose of the study was to investigate the distinctness and reliability of analytic (or multitrait) rating dimensions and their relationships to holistic scores and "e-rater"® essay feature variables in the context of the TOEFL® computer-based test (CBT) writing assessment. Data analyzed in the study were analytic and holistic…