Testing programs are often classified as high or low stakes to indicate how stringently they need to be evaluated. However, in practice, this classification falls short. A high-stakes label is taken to imply that all indicators of measurement quality must meet high standards; whereas a low-stakes label is taken to imply the opposite. This approach…

Haertel's argument is that one must "expand the scope of test validation to include indirect testing effects" because these effects are often the "rationale for the entire testing program." The author strongly agrees that this is essential. However, he maintains that Haertel's argument does not go far enough and that there are two additional…

The work reported in this paper reflects a collaborative effort of many individuals representing multiple organizations. It began during a session at the October 2008 meeting of TILSA when a representative of a member state asked the group if any of their programs had experienced unexpected fluctuations in the annual state assessment scores, and…

Ten years have passed since President George W. Bush signed No Child Left Behind (NCLB), making it the educational law of the land. A review of a decade of evidence demonstrates that NCLB has failed badly both in terms of its own goals and more broadly. It has neither significantly increased academic performance nor significantly reduced…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

This report is the first in a series of reports describing results from the Center on Education Policy's (CEP's) third annual analysis of state testing data. The report provides an update on student performance at the proficient level of achievement, and for the first time, includes data about student performance at the advanced and basic levels.…

Many in the research and policy worlds have taken for granted the existence of a phenomenon known as the "plateau effect," wherein test scores rise in the early years of a test-based accountability system and then level off. Drawing from our database of reading and math test results from all 50 states going back as far as 1999, the…

The No Child Left Behind Act sanctions the use of NAEP scores to confirm state testing results. The U.S. Department of Education, as test developer, is responsible to set forth how NAEP scores are to be interpreted and used. Thus far, the Department has not published a clear set of guidelines for using NAEP achievement level scores to conduct a…

A critical, but often neglected, component of any large-scale assessment program is the reporting of test results. In the past decade, a body of evidence has been compiled that raises concerns over the ways in which these results are reported to and understood by their intended audiences. In this study, current approaches for reporting…

Title I provides extra instructional services designed to raise achievement for low-performing students in schools with relatively high poverty rates, and for all students in many of the nation's highest-poverty schools. To learn more about how well Title I students are performing academically, the Center on Education Policy (CEP) compared…

Most states do not offer reciprocity for other state assessment tests. That practice has an adverse effect on school-aged, dependent children of military service members. President Clinton's 1997 solution was a national standardized assessment test for public school students. Critics stated it would cost $96,000,000 to deliver the test. Florida…

Problems of scale typically arise when comparing test score trends, gaps, and gap trends across different tests. To overcome some of these difficulties, we can express the difference between the observed test performance of two groups with graphs or statistics that are metric-free (i.e., invariant under positive monotonic transformations of the…

This is the 2011 Yearbook of the National Council of Professors of Educational Administration (NCPEA). This Yearbook contains five parts. Part I, Invited Chapters, includes: (1) NCPEA President's Message, 2011 (Gary W. Kinsey); (2) Shadows and Images II (Lloyd Duvall); and (3) Micropolitics in the School: Teacher Leaders' Use of Political Skill…

The purpose of implementing an assessment and accountability program in an urban school district is to improve student learning of worthwhile content. Current levels of achievement in most U.S. urban districts are unacceptably low. Average achievement test results conceal the fact that achievement levels of students of color are substantially…