The judgmental approaches used by the Governing Board to set National Assessment of Educational Progress achievement levels have been the subject of a great deal of controversy and have sometimes led to results that were considered "unreasonable." The NCES requirement that the achievement levels be used on a trial basis and be…

Uses the validity framework developed by S. Messick (1995, 1996) to outline six aspects of construct validation to guide the validation of performance-based assessments: (1) content;(2) substantive; (3) structural; (4) generalizability; (5) external; and (6) consequential. (SLD)

Many states have adopted test-based accountability systems before the No Child Left Behind (NCLB) Act of 2001 became law. NCLB has added a new dimension to test-based educational accountability systems. Features of state and NCLB accountability are discussed with an emphasis on questions of the validity of inferences that are made about school…

The National Assessment of Educational Progress (NAEP) must use sampling techniques that produce data which are representative on national, state, and local levels. The validity of findings is enhanced when state and district comparisons are made. Multiple measures will allow the diagnosis of strengths and weaknesses. The data should be…

Almost every state has in place a state assessment and accountability system. These systems vary greatly in their characteristics but share a common global purpose of improving teaching and learning. Some of the variations in the state systems are discussed and illustrated with examples from selected states. Issues that are critical to the value…

The validity of interpretations of National Assessment of Educational Progress (NAEP) achievement levels is evaluated by focusing on evidence regarding three types of discrepancies: (1) between standards; (2) among descriptions of achievement levels; and (3) between assessments and content standards. All of these discrepancies raise serious…

This book is intended to introduce the classroom teacher and prospective teacher to the elements of measurement and assessment that are essential to good teaching. The main theme is that assessment plays an important role in the instructional process. This edition has been revised to reflect major changes in educational assessment since the last…

The internal validity of the RMC models, especially Model A, is examined. Concern centers on limiting evaluation to cognitive outcomes, using constant percentile as the no-treatment expectation, and using norms for one test to establish the expected no-treatment performance level for another test. (MH)

Current national efforts to expand the role of educational assessment and change the nature of assessments are discussed. Rationales for expectations that a new national examination would spur educational reform are analyzed; and the challenges of performance-based assessment, particularly in its validation, are examined. (Author/SLD)

Increasing emphasis on assessment and concern about assessment techniques have stirred interest in alternative assessment forms, for which evidence is needed about consequences, transfer of performance on specific assessment tests, and assessment fairness. Criteria concerning consequences, fairness, transfer-generalizability, cognitive complexity,…

The statute authorizing the National Assessment of Educational Progress (NAEP) calls for the National Assessment Governing Board (NAGB) to set appropriate achievement levels in all areas and grades tested by the NAEP. These levels are intended to establish what students should know, not just what they do know. In 1990, the NAEP posited three…

The three RMC models endorsed by the U.S. Office of Education for the evaluation of Elementary and Secondary Education Act Title I programs are based on narrowly conceived approaches to evaluation--the measurement of cognitive achievement gains. Each model requires the comparison of observed student performance with an estimate of what level of…