Many large-scale performance assessments include score resolution procedures for resolving discrepancies in rater judgments. The goal of score resolution is conceptually similar to person fit analyses: To identify students for whom observed scores may not accurately reflect their achievement. Previously, researchers have observed that…

Background: For language teachers, using rubrics has become the norm in assessing performance-based work. When using rubrics, one question stakeholders have is to what extent teachers are true to the rubrics. For classroom teachers, the correct use of rubrics is crucial. Rater training and rater calibration are not commonly offered to…

The dangers of a single story in current U.S. large-scale writing assessment are that assessment practice does not align with theory and this practice has negative effects on instruction and students. In this article, I analyze the connections or lack of connections among writing theory, writing assessment, and writing instruction, critique the…

Background: Many in education argue for the importance of incorporating teacher judgements in the assessment and reporting of student performance. Advocates of such an approach are cognisant, though, that obtaining a satisfactory level of consistency in teacher judgements poses a challenge. Purpose: This study investigates the extent to which the…

In 1989 the Portland (Oregon) Public Schools conducted a Direct Writing Assessment of approximately 6,000 students. A voluntary portion included 103 ninth graders who wrote essays on the same topic. The papers were scored twice: once in each student's handwriting and once in word-processed form. Papers were separated into short and long categories…

The similarity of information provided by direct and indirect methods of writing assessment was investigated using 219 tenth graders. A resulting cognitive model of writing skills indicates that practitioners interested in reliably measuring all aspects of the proposed writing process continuum use both direct and indirect methods. (TJH)

The New Standards Project is a joint effort of the Learning Research and Development Center (LRDC) at the University of Pittsburgh (Pennsylvania) and the National Center on Education and the Economy toward creation of a national examination system based on performance assessments. This study explored the feasibility of comparing performance on…

Some potential relative advantages of performance assessment strategies over paper-and-pencil tests using short-answer and multiple-choice item formats are discussed. The major advantage of the multiple-choice test is its ability to sample a large number of learning outcomes efficiently. However, performance assessments are increasingly being used…

The development of written language and its functions were studied for 236 second graders (from four locations in the surrounding Birmingham, Alabama area) in 6 traditional and 6 writing process classrooms. Pen pal letters to undergraduates and written samples were obtained from three students from each class. Writing process classrooms reflect…

This research examined the results from direct and indirect writing assessments to determine the most effective method of discrimination. The New Jersey State Department of Education developed a test for ninth-grade students which was designed to measure the ability to apply writing mechanics to written text and to communicate effectively in…

The validity and reliability of two techniques of assessing writing proficiency were compared in a sample of 300 South African students (in Standard 8) for whom English was a second language. The objective, multiple choice method was compared with a subjective, essay method. Students completed a Standard English Second Language Item Bank Test and…