Each fall the author assigns undergraduate teacher education students to design rubrics that they can use to evaluate auditions for reality television shows like "American Idol." The point is to draw students into a critical reflection on assessment literature and practices they have been studying. Through these reflections, the author…

This study examined the number of writing samples needed to obtain a reliable estimate of young struggling writers' capabilities. It further assessed if performance in one genre was reflective of performance in other genres for these children. Second- and third-grade students (81 boys, 56 girls), who were identified as struggling writers in need…

With a view to support instruction, formative and summative assessment and to provide model handwriting performance for students to compare their own performance, a Malayalam handwriting scale is developed. Data from 2640 school students belonging to Malappuram, Palakkad and Kozhikode districts, sampled by taking 240 students per each grade…

Various computer tools have been developed to support educators' assessment of student writing, including automated essay scoring and automated writing evaluation systems. Research demonstrates that these systems exhibit relatively high scoring accuracy but uncertain instructional efficacy. Students' writing proficiency does not necessarily…

Raimes (1983) has identified nine components necessary to produce a piece of writing that is clear, fluent and effective. These are also the aspects that are considered when assessing writing. The common practice is to have raters score the essays and they are provided with a rating scale for this purpose. A training and practice session is also…

This study examined the effects of marking method and rater experience on ESL (English as a Second Language) essay test scores and rater performance. Each of 31 novice and 29 experienced raters rated a sample of ESL essays both holistically and analytically. Essay scores were analysed using a multi-faceted Rasch model to compare test-takers'…

Investigates the developmental, gender, and practical considerations surrounding three categories of Curriculum Based Management written language scoring indices. With only one exception, older students outperformed younger students on all of the scoring indices. Although at the middle school level students' levels of writing fluency and writing…

Intended to familiarize persons with the scoring standards and criteria used for the Georgia Basic Skills Writing Test, this scoring manual is in eight sections: (1) an introduction to the scoring dimensions and scale points; (2) definitions of the four scale points; (3) definitions of scoring dimensions and components (content and organization,…

Because there is no commonly accepted view of what makes for good writing, automated essay scoring (AES) ideally should be able to accommodate different theoretical positions, certainly at the level of state standards but also perhaps among teachers at the classroom level. This paper presents a practical approach and an interactive computer…

Intended to familiarize persons with the scoring standards and criteria used for the 6th grade version of the Georgia Criterion-Referenced Writing Test, this scoring manual is in eight sections: (1) an introduction to the scoring dimensions and scale points; (2) definitions of the four scale points; (3) definitions of scoring dimensions and…

Intended to familiarize persons with the scoring standards and criteria used for the 8th grade version of the Georgia Criterion-Referenced Writing Test, this scoring manual is in eight sections: (1) an introduction to the scoring dimensions and scale points; (2) definitions of the four scale points; (3) definitions of scoring dimensions and…

Using data from the SCRE Criterion Test composition papers, the author tests the hypothesis that the bulk of inter-marker unreliability is caused by inter-marker inconsistency--which is not correctable statistically. He suggests that a shift to "consensus" standards will realize greater improvements than statistical standardizing alone.…

Discusses problems with scoring reliability of the Vermont Education Department's writing portfolio test, particularly the difficulties teachers face in agreeing upon scoring criteria. (PA)

This study evaluated a "substantively driven" method for scoring NAEP writing assessments automatically. The study used variations of an existing commercial program, e-rater[R], to compare the performance of three approaches to automated essay scoring: a "brute-empirical" approach in which variables are selected and weighted solely according to…

Experiences with competency testing at the elementary level in the area of English language are presented, as well as suggestions for improving the quality of competency tests. In order to modify curricula and requirements to meet the demands of assessment and to ensure sufficient student instruction, the following suggestions are made: (1)…