A new approach for examining the quality of judgments from standard-setting judges using a Binomial Trials Model (BTM) is presented and illustrated with 26 judges from the Georgia High School Graduation Test. Results suggest that the BTM provides information not available from other methods. (SLD)

This document contains the results of a standard setting conducted in January 2002 on the Delaware Student Testing Program (DSTP) Science and Social Studies tests at grades 4 and 6. Each standard setting process entailed convening four groups, one for each grade level and content area, and each group met for 2 days. At the standard setting judges…

This document contains the results of a standard setting conducted between August 2 and August 12, 1999, on the Delaware Student Testing Program (DSTP) Mathematics, Reading, and Writing subtests at grades 3, 5, 8, and 10. At the standard setting, judges were asked to recommend only the cut point between "Below the Standard" and…

This paper reports on the investigation of the operation of the Teacher of the Year Award program in 28 states. It focuses on the method of selection for recipients of this award, and explores the nature of the judging process used in selecting candidates at both the state and national levels. Specific objectives are: (1) to determine the criteria…

State legislators across the country have responded with new efforts to change the authority and practice of the juvenile and criminal justice systems. Since 1992, 48 of the 51 state legislatures (including the District of Columbia) have made substantive changes to their juvenile justice laws. This report presents the first comprehensive analysis…

The research described in this paper examines the relationship between raters and the training raters receive to apply that rating. The primary concern is maintaining scoring consistency within the context of raters' perceptions. If the criteria for holistic and/or analytic scoring can be recognized as communication based, rather than topic based,…

Part I of this report describes processes used to develop and implement the 2-year Multidisciplinary Institute for Child Sexual Abuse Intervention and Treatment Project. The underlying focus of the 5-day training sessions is a team approach to investigation, intervention, and treatment. A process description discusses the impetus for the project…

Technical questions regarding the reliability and validity of large-scale portfolio assessment were studied which focused on: (1) whether raters can score collections of writing reliably with rubrics designed for single samples; (2) whether ratings derived from different frameworks differ in their capacities to support technically sound…

The assessment instruments of the Maine Educational Assessment emphasize extended constructed-response questions. The results from these assessments are reported in terms of percentages of students at four performance levels. The Student-Based Constructed-Response Method was used to establish performance standards for these levels on the…