The judgmental approaches used by the Governing Board to set National Assessment of Educational Progress achievement levels have been the subject of a great deal of controversy and have sometimes led to results that were considered "unreasonable." The NCES requirement that the achievement levels be used on a trial basis and be…

Uses the validity framework developed by S. Messick (1995, 1996) to outline six aspects of construct validation to guide the validation of performance-based assessments: (1) content;(2) substantive; (3) structural; (4) generalizability; (5) external; and (6) consequential. (SLD)

Suggest that the insistence on reporting in terms of performance standards in situations where they are not essential has been more harmful than helpful. Discusses variability in the definitions of proficient academic achievement by status for purposes of the No Child Left Behind Act of 2001. (SLD)

This focus of this newsletter asserts that if one accepts that accountability systems are intended to serve both symbolic and technical functions, one can ask how well they are operating symbolically to motivate action and how well they are doing in providing adequate technical information to support intended inferences. In this column, it is…

Generalizability of performance-based assessment scores across raters and tasks is examined, focusing on implications of generalizability analyses for specific uses and interpretations of assessment results. Although it seems probable that assessment conditions, task characteristics, and interactions with instructional experiences affect the…

This book is intended to introduce the classroom teacher and prospective teacher to the elements of measurement and assessment that are essential to good teaching. The main theme is that assessment plays an important role in the instructional process. This edition has been revised to reflect major changes in educational assessment since the last…

Major changes underway with regard to educational assessment include an increased role for the federal government; increased emphasis on standards; and increased reliance on performance assessment. These changes are the context for the effort to revise the "Standards for Educational and Psychological Testing." (SLD)

Although the use of test results to demonstrate educational shortcomings is important, tests and assessments are also expected to be an instrument of reform. In fact, they are often expected to provide the primary means of creating educational reform. The minimum competency testing movement and the expansion of the use of test results for…

The New Standards Project conducted a pilot test of a series of performance-based assessment tasks in mathematics and English language arts at Grades 4 and 8 in the spring of 1993. This paper reports the results of a series of generalizability analyses conducted for a subset of the 1993 pilot study data in mathematics. Generalizability analyses…

Current national efforts to expand the role of educational assessment and change the nature of assessments are discussed. Rationales for expectations that a new national examination would spur educational reform are analyzed; and the challenges of performance-based assessment, particularly in its validation, are examined. (Author/SLD)

The New Standards Project is a joint effort of the Learning Research and Development Center (LRDC) at the University of Pittsburgh (Pennsylvania) and the National Center on Education and the Economy toward creation of a national examination system based on performance assessments. This study explored the feasibility of comparing performance on…

Current national efforts to expand the role of educational assessment and radically change the nature of assessment are discussed. Rationales for expectations that a new national examination system would serve as a lever of educational reform are analyzed. Challenges posed for educational measurement by the proposed heavy reliance on complex,…

The Center for Research on Evaluation, Standards, and Student Testing (CRESST) attempts to advance the understanding of educational quality by research and development on the design, implementation, analysis, and use of assessment information. CRESST's research programs are directed at five major goals: (1) provide leadership to improve assessment…

Increasing emphasis on assessment and concern about assessment techniques have stirred interest in alternative assessment forms, for which evidence is needed about consequences, transfer of performance on specific assessment tests, and assessment fairness. Criteria concerning consequences, fairness, transfer-generalizability, cognitive complexity,…

The use of portfolio assessment as a method of evaluating the writing competence of elementary school students was studied. The study contained two components: (1) an empirical study of the utility and meaningfulness of using an analytic rubric developed for the evaluation of traditional writing samples to score student portfolios; and (2) a…