Linking score scales across different tests is considered speculative and fraught, even at the aggregate level (Feuer et al., 1999; Thissen, 2007). We introduce and illustrate validation methods for aggregate linkages, using the challenge of linking U.S. school district average test scores across states as a motivating example. We show that…

This study examines the effectiveness of three approaches for maintaining equivalent performance standards across test forms with small samples: (1) common-item equating, (2) resetting the standard, and (3) rescaling the standard. Rescaling the standard (i.e., applying common-item equating methodology to standard setting ratings to account for…

This guide is designed to assist States, agencies, and/or facilities who work with youth who are neglected, delinquent, or at-risk (N or D). The information in the guide will benefit those who are (a) interested in implementing pre-posttests, (b) in the process of identifying an appropriate pre-posttest, or (c) ready to evaluate current testing…

Standardized achievement tests that are used for assessment and accountability purposes may not provide reliable and valid outcomes for English language learners (ELLs) because extraneous sources may confound the outcome of assessments for these students. Performance assessments, by contrast, may offer opportunities for these students to present a…

Bracey looks at three well-known assessments--the National Assessment of Educational Progress, the Program of International Student Assessment, and the Trends in Mathematics and Science Study--and concludes that their "instruction-insensitive" design makes them inappropriate as measures of education quality in schools, districts, states,…

The National Assessment Governing Board used a new method to set achievement level standards on the 2005 Grade 12 NAEP Math test. In this article, we summarize our independent evaluation of the process used to set these standards. The evaluation data included observations of the standard-setting meeting, observations of advisory committee meetings…

A study involving 593 students (ages 15-29) with deafness investigated the validity of a shortened version of the Transition Competence Battery for Deaf Adolescents and Young Adults (TCB). Overall results suggest that the "Mini" TCB is a viable assessment tool that can be used in transition assessment. (Author/CR)

In this publication, designed to serve interested laymen as well as educators, various authors explore the viewpoints of the proponents and the opponents of the National Assessment Program. In their analysis of assessment and its related issues, these authors attempt to provide information that could serve as a basis for an objective consideration…

The most fundamental technical quality issue raised by proposals for a national examination system is that of validity. Types of evidence needed to judge the validity of test use and the interpretation of results are discussed, and examination content, fairness, impact, generalizability, and comparability are explored. (SLD)

Current national efforts to expand the role of educational assessment and radically change the nature of assessment are discussed. Rationales for expectations that a new national examination system would serve as a lever of educational reform are analyzed. Challenges posed for educational measurement by the proposed heavy reliance on complex,…

The report of the National Academy of Education (NAE), "Setting Performance Standards for Student Achievement," provides an interpretation of NAE investigations into the procedures surrounding establishment of achievement levels for the National Assessment of Educational Progress (NAEP). The NAE report synthesizes the investigations of…

Participants in this conference of educators, convened to consider methods of evaluating teacher education students, focused upon the relationship between candidate quality and teacher effectiveness. Questions under consideration included: (1) pre-admission field experiences students should demonstrate; (2) optimum scores on aptitude and…

In this paper, the author reviews a number of criticisms that have been made of the use of standardized tests in the social studies and reviews 11 general, skills, and discipline-oriented standardized tests for social studies. Standardized tests evaluating the results of the new social studies courses are open to criticism on the basis of…

This report of the development and validation of a criterion-referenced examination for physician's assistants contains an overview of phase 1 project activities (1972-74) and more detailed description and data on phase 2 activities (1975-76). The overview describes the rationale for the development of the examination. (It was the first certifying…

It has long been assumed that Part 3 of the National Boards, which stresses patient management and clinical problems, is a valid measure of "clinical competence" for doctors. These authors, challenging this premise, devised a study to analyze which components of medical school achievement are most predictive of Part 3 performance. Their…