The purpose of this study is to illustrate the use of explanatory models based on Rasch measurement theory to detect systematic relationships between student and item characteristics and achievement differences using differential item functioning (DIF), differential group functioning (DGF), and differential person functioning (DPF) techniques. The…

This study investigated the use of automated essay scoring (AES) to identify at-risk students enrolled in a first-year university writing course. An application of AES, the "Criterion"[R] Online Writing Evaluation Service was evaluated through a methodology focusing on construct modelling, response processes, disaggregation, extrapolation,…

Automated Essay Scoring (AES) has garnered a great deal of attention from the rhetoric and composition/writing studies community since the Educational Testing Service began using e-rater[R] and the "Criterion"[R] Online Writing Evaluation Service as products in scoring writing tests, and most of the responses have been negative. While the…

This article presents considerations for using automated scoring systems to evaluate second language writing. A distinction is made between English language learners in English-medium educational systems and those studying English in their own countries for a variety of purposes, and between learning-to-write and writing-to-learn in a second…

This analysis of 83 scoring rubrics and grade definitions from writing programs at U.S. public research universities captures the current state of the struggle to define and measure specific writing traits, and it enables an induction of the underlying theoretical construct of "academic writing" present at these writing programs. Findings suggest…

Rating scales act as the de facto test construct in a writing assessment, although inevitably as a simplification of the construct (North, 2003). However, it is often not reported how rating scales are constructed. Unless the underlying framework of a rating scale takes some account of linguistic theory and research in the definition of…

This article describes a three-step pedagogy aimed at developing college ESL students' ability to assess and evaluate their own writing through intentional learner training. The three pedagogical steps are teacher modeling, guided peer assessment, and independent self-assessment. To illustrate, a set of scaffolded instructional procedures are…

At 12:30 p.m. on December 8, 1941, in front of a joint session of Congress, one day after Japanese planes struck Pearl Harbor and killed 2,402 Americans, President Franklin Delano Roosevelt declared December 7 a date that would live in infamy. He spoke of rage and betrayal, hardships and determination. Thirty-three minutes after he finished…

This protocol guided the review of research that informed the recommendations contained in the What Works Clearinghouse (WWC) practice guide "Teaching Elementary School Students to Be Effective Writers." This protocol was developed to reflect standard WWC procedures for reviewing research. The protocol also was informed by the objectives…

With massive utilization of Automated Writing Evaluation (AWE) tools, it is feasible to detect English as a Foreign Language (EFL) learners' lexical application so as to improve their writing quality. This study aims to explore Chinese EFL learners' lexical application to see if AWE-based writing can bring about positive effects of lexicon on…

This study examines the syllabi of 241 required organizational behavior (OB) related classes in full-time U.S. MBA programs. Syllabi were coded for information about course title, topics, readings, cases, teaching methods, and learning assessment methods. Results revealed that the most frequent topics listed across courses are leadership and…

Plagiarism is a growing problem for universities, many of which are turning to software detection for help in detecting and dealing with it. This paper explores issues around plagiarism and reports on a study of the use of Turnitin in a new university. The purpose of the study was to inform the senior management team about the plagiarism policy…

An important task for foreign language (FL) instructors and researchers is to understand how the development of each language skill affects other aspects of language acquisition. This case study seeks to determine if speaking and writing proficiencies develop at similar rates among FL learners. Seventeen students enrolled in beginning,…

Computer and Internet literacy is often taken for granted in the case of young adults born into the digital world; it is generally assumed that they can all use technology effectively. However, as mentioned by Fowley (2011), "it is easy to forget that in Ireland for example, many of the young people whom we routinely call digital natives have…

The purpose of this study was to examine the role of vocabulary in writing across three genres. Fifth graders (N = 105) wrote three compositions: story, persuasive, and informative. Each composition revolved around the topic of outer space to control for background knowledge. Written compositions were scored for holistic writing quality and…