Purpose: This study intended to examine the generalizability and reliability of essay ratings within the scope of the generalizability (G) theory. Specifically, the effect of raters on the generalizability and reliability of students' essay ratings was examined. Furthermore, variations of the generalizability and reliability coefficients with…

Evaluation of student written work during summative assessments is an important and critical task for instructors at all educational levels. Nevertheless, few research studies exist that provide insights into how different instructors approach this task. Chemistry faculty (FIs) and graduate student instructors (GSIs) regularly engage in the…

Background: Many in education argue for the importance of incorporating teacher judgements in the assessment and reporting of student performance. Advocates of such an approach are cognisant, though, that obtaining a satisfactory level of consistency in teacher judgements poses a challenge. Purpose: This study investigates the extent to which the…

Despite the growing body of research on writing assessment, little attention has been devoted to developing and validating measures for beginning writers. This study examined the technical adequacy of a Sentence Writing measure with 233 students in kindergarten and first grade. The reliability, validity, and sensitivity to growth were investigated…

Many national reports indicate that more attention needs to be placed on writing and the teaching of writing in schools. The purpose of this quantitative study was to, first, examine the structure of the DWA and, second, to use the scores from the DWA to examine the relationship between ELL status and writing proficiency. Five major research…

The authors explored the credibility of using informal reading inventories and writing samples for 138 students (K-4) to evaluate the effectiveness of a summer literacy program. Running Records (a measure of a child's reading level) and teacher experience during daily reading instruction were used to estimate the reliability of the more formal…

This study describes validation data for qualitative and quantitative writing measures useful with a full range of students, including special education students, in grades three through five. The study looked for consistent administration and scoring, sensitivity in differentiating groups of students, relation to other accepted assessments, and…

Students at grades four and five were administered a writing assessment that was developed to correspond to the California Learning Assessment System (CLAS) writing tasks at grade four. Teachers were trained to score the CLAS-like tasks according to the rubric developed by the State for CLAS. In addition, 164 students at three schools in the…

A study of 943 personal narratives of students with deafness evaluated the effectiveness of the Six-Trait Analytical Scale in assessing student's writing. The scale was found to be reliable and valid in evaluating written narratives of students with and without hearing losses and is recommended as a valuable diagnostic instrument and instructional…

This paper provides principles which can be used to mark mathematics papers in secondary schools. Sections included are: (1) "Drafting the Marking Scheme" (describing 15 general considerations); (2) "Calculations" (listing 16 grading principles on computation papers); (3) "Graphs" (providing four guidelines on graph papers); (4) "Constructions"…

Recent information from established testing programs was used to investigate the nature and limitations of essay and multiple-choice tests of writing ability, the statistical relationship of these types of tests, the performance of population subgroups on each, the possible need of different disciplines for different tests of composition skill,…

The reliability of four measures of written expression was examined (total words written, mature words, words spelled correctly, and letters in sequence). Subjects included elementary-age students in several school districts, some of whom were learning disabled. Results revealed high coefficients for test-retest reliability, parallel-form…

Examined the generalizability of written-response scores on the English 30 diploma examination administered to Alberta 12th-grade students. Student scores differed as a function of rater, but this variance component was small across two tasks and two administrations; score generalizability was high using a two-rater system; and scale variability…

The Computerized Inventory of Developmental Writing Traits (CIDWT) is meant to provide a valid reliable measure of program improvement, particularly for teachers implementing a process writing approach in their classrooms. While standardized tests, portfolio, and holistic scoring all have something to offer, the CIDWT is an inexpensive direct…

This ERIC Digest was adapted from the Association for Childhood Education International's (ACEI) 1991 position paper on standardized testing. Since the publication of "A Nation at Risk" in 1983, standardized testing programs have expanded greatly. Tests may be of pencil-and-paper or performance-oriented varieties. The purposes of tests…