School grades provide an easily understandable metric to measure the performance of a school. Parents and the general public can use the school grade and its associated components to understand how well each school is serving its students. The purpose of this technical guide is to provide a description of the procedures used to determine school…

Precision is a key facet of test development, with score reliability determined primarily according to the types of error one wants to approximate and demonstrate. This article identifies and discusses several primary forms of reliability estimation: internal consistency (i.e., split-half, KR-20, a), test-retest, alternate forms, interscorer, and…

School grades provide an easily understandable metric to measure the performance of a school. Parents and the general public can use the school grade and its associated components to understand how well each school is serving its students. The school grades calculation was revised substantially for the 2014-15 school year to implement statutory…

School grades provide an easily understandable metric to measure the performance of a school. Parents and the general public can use the school grade and its associated components to understand how well each school is serving its students. The school grades calculation was revised substantially for the 2014-15 school year to implement statutory…

Each fall the author assigns undergraduate teacher education students to design rubrics that they can use to evaluate auditions for reality television shows like "American Idol." The point is to draw students into a critical reflection on assessment literature and practices they have been studying. Through these reflections, the author…

School grades provide an easily understandable metric to measure the performance of a school. Parents and the general public can use the school grade and its associated components to understand how well each school is serving its students. The school grades calculation was revised substantially for the 2014-15 school year to implement statutory…

School grades provide an easily understandable metric to measure the performance of a school. Parents and the general public can use the school grade and its associated components to understand how well each school is serving its students. The school grades calculation was revised substantially for the 2014-15 school year to implement statutory…

The New York State Board of Regents has committed to the transformation of the preparation, support and evaluation of all teachers and school leaders in New York State, and the New York State Legislature has enacted historic legislation (Education Law §3012-c) that fundamentally changes the way teachers and principals are evaluated. Under the new…

AIR is working with states and districts across the country to improve teacher evaluation and feedback. Our work is focused on designing systems of educator evaluation and compensation that incorporate multiple measures of performance and, in particular, measures of student growth. In this work, student learning objectives (SLOs) have emerged as a…

To rule out the need for a two-parameter item response theory (IRT) model during item analysis by Rasch models, it is important to check the Rasch model's assumption that all items have the same item discrimination. Biserial and polyserial correlation coefficients measuring the association between items and restscores are often used in an informal…

This paper describes how a state education system in Australia introduced standards-referenced assessments into its large-scale, high-stakes, curriculum-based examinations in a way that enables comparison of performance across time even though the examinations are different each year. It describes the multi-stage modified Angoff standard-setting…

The need to determine eligibility for a program for intellectually gifted students resulted in combining deviation scores on achievement, aptitude, ability and motivation measures into a matrix score. These matrix scores and the students' success in the program were determined for present participants. Students were classified as successful or…

The essay on the writing section of the SAT will be scored using a holistic approach. In holistic scoring, a piece of writing is considered as a total piece of work--the whole of which is greater than the sum of its parts.

There have been many attempts to formulate a procedure for extracting information from incorrect responses to multiple choice items, i.e., the assessment of partial knowledge. The results of these attempts can be described as inconsistent at best. It is hypothesized that these inconsistencies arise from three methodological problems: the…

Due to the high stakes that my be attached to placement decisions, it is imperative that the placement process be as solid and defensible as possible. An integral part of the placement process is the identification and use of cut scores, the point(s) on the score scale that classify students into adjacent categories for placement decisions. This…