This study investigates the relative efficacy of using linguistic micro-features, the aggregation of such features, and a combination of micro-features and aggregated features in developing automatic essay scoring (AES) models. Although the use of aggregated features is widespread in AES systems (e.g., e-rater; Intellimetric), very little…

Picture a group of classroom teachers gathered around a table late one afternoon discussing the results of the statewide writing assessment, the returned scored papers scattered across the table top. This article details research exploring which rhetorical elements are associated with statewide assessment scores and considers the role and…

In this article, the author describes the benefits of a program where he has taught for many years. It is a program that emphasizes personal narratives drawn from memory--and that also celebrates the personal essay, which usually incorporates narrative content. The article begins by addressing concerns expressed about this form of writing. It then…

Common estimators of interrater reliability include Pearson product-moment correlation coefficients, Spearman rank-order correlations, and the generalizability coefficient. The purpose of this study was to examine the accuracy of estimators of interrater reliability when varying the true reliability, number of scale categories, and number of…

Research on the marking process has focused mainly on judgement and strategy use. Previous studies have depicted the marking process as a monolithic sequence of marking single scripts, and primarily in examination marking contexts. The present study investigated the marking process encompassing aspects relatively neglected in previous research:…

This paper examines the construct measured by automated essay scoring (AES) systems. AES systems measure features of the text structure, linguistic structure, and conventional print form of essays; as such, the systems primarily measure text production skills. In the current state-of-the-art, AES provide little direct evidence about such matters…

In this paper, I describe the design and evaluation of automated essay scoring (AES) models for an institution's writing placement program. Information was gathered on admitted student writing performance at a science and technology research university in the northeastern United States. Under timed conditions, first-year students (N = 879) were…

This article discusses the results of a study that investigated the use of different procedures to support the reflection processes of university-level dance students. As a procedure of unguided reflection, the students were asked to write a free-form essay and, as a form of guided reflection, a semi-structured interview and written reflection…

Word cloud generating applications were originally designed to add visual attractiveness to posters, websites, slide show presentations, and the like. They can also be an effective tool in reading and writing classes in English as a second language (ESL) for all levels of English proficiency. They can reduce reading time and help to improve…

Idea generation is an important component of most major theories of writing. However, few studies have linked idea generation in writing samples to assessments of writing quality or examined links between linguistic features in a text and idea generation. This study uses human ratings of idea generation, such as "idea fluency, idea…

In first-year writing (FYW), instructors want students to understand how reading texts in particular ways affects how and what they learn and, in turn, how and what they might communicate to their own readers. Because students tend to come to FYW predisposed to notice more visual aspects (e.g., headings, bulleted lists) than verbal aspects (e.g.,…

Personal narrative essays were used to analyze the experiences of four Latina doctoral students who completed their first year in an educational leadership doctoral program in a Hispanic-Serving Institution (HSI) in the southwestern U.S. Four themes emerged from their "testimonios" 1) "Con todo el corazón"; 2) "Somos como…

This study investigates the influence of the semantic heaviness of verbs (i.e., heavy or light verbs) and language proficiency on second language (L2) learners' use of constructional information in a sentence-sorting task and a corpus analysis. Previous studies employing a sentence-sorting task demonstrated that advanced L2 learners sorted English…

The study is a qualitative case study that investigated the patterns of interactions among ESL students during their online interactions to complete their narrative essays. The study found that students were engaged in interactions related to language related assistance, using partner as a resource and providing encouragement as suggested by…

An emerging literature demonstrates that relevance interventions, which ask students to produce written reflections on how what they are learning relates to their lives, improve student learning outcomes. As part of a randomized evaluation of a relevance intervention (N = 1,978 students from 82 ninth-grade classes), we used Complier Average Causal…