For paired rankings data, a statistical test is proposed to detect whether subjects' posttreatment rankings have moved systematically toward an unknown ranking or set of rankings. Using paired-rankings from 38 ninth graders in a writing and literary criticism course, graphical methods for representing the data are presented. (SLD)

Outsiders (i.e., regulators, adjudicators, and "messiahs") frequently arrive with insistent demands for school change. The demands of these interest groups should not be set ahead of those of legitimate stakeholders at the school level. Having some interest at risk and commitment are characteristics that distinguish stakeholders from…

During the past 3 years, the Oral History Project Study Team, which comprises Jean King, Mel Mark, and Robin Miller, has conducted interviews with individuals who have made signal contributions to the program evaluation field. Their goal was to capture the professional evolution of those who have contributed to the way evaluation in the United…

As is typically the case when this author sets fingers to keyboard and writes about evaluation, his intent is to offer his work and perspective as "one" African American evaluator. The impetus for the thoughts and ideas he expresses in this article were prompted by his preparation to attend and present a paper at the inaugural annual…

This article presents a brief history of the National Science Foundation's involvement in education evaluation, reviews the program evaluations that NSF's Division of Research, Evaluation, and Communication (REC) has conducted in recent years, and describes future directions. The evaluations have reflected the field-driven nature of NSF's…

This brief examines how the ACT's EPAS[TM] (Educational Planning and Assessment System) can be used to evaluate school-based intervention programs. Specific evaluation considered is that of the federal government's Gaining Early Awareness and Readiness for Undergraduate Programs (GEAR UP), an initiative designed to increase the college awareness…

This issue of "The Evaluation Exchange" describes new developments in evaluating advocacy and policy change efforts that attempt to inform or influence public policy at the local, state, or federal levels. Heather B. Weiss introduces the themes in this issue in "From the Director's Desk," examining how evaluation of advocacy…

In this article, the authors trace the emergence of an institutional discourse of ethical research and interrogate its effects in constituting what ethical research is taken to be and how ethical researchers are configured. They illuminate the dissonance between this regime of truth and research practice and the implications for the injunction to…

Preliminary data was gathered to guide subsequent research that will shape training procedures and scoring practice for performance assessment activities that integrate multiple content areas. Content area integration is a key feature of many of the tasks in the Maryland School Performance Assessment Program (MSPAP), a large-scale assessment of…

This paper presents preliminary, but statistically significant, findings from a study that compares two methods of measuring instructional effectiveness: global evaluation by experts and systematic observation using the SCRIBE Ob.2 software developed at the University of Texas at Austin. Hierarchical instruction of a performance skill…

This study was undertaken to test the hypothesis that items of the Test of English as a Foreign Language (TOEFL) containing reference to American people, places, customs, etc., tend to favor examinees who have spent some time living in the United States. Two samples of examinees were drawn from the March 1987 TOEFL administration, one tested in…

The Educational Testing Service is developing a new generation of teacher assessments--the Praxis Series: Professional Assessments for Beginning Teachers. The assessment series consists of three components. An academic skills component will assess the candidate's basic academic and enabling skills. Subject assessments will test the candidate's…

A study was conducted to determine the extent to which public school teachers of kindergarten through grade 6 have experienced formal evaluations in their current school and the procedures employed in evaluating teacher performance. The nationally representative Survey on Teacher Performance Evaluations was administered to approximately 1,000…

The design, administration, scoring, and results of the 1993 New York State Correctional Captain Examination are described. The examination was administered to 405 candidates. As in previous Sergeant and Lieutenant examinations, candidates also completed latent image written simulation problems and open/closed book multiple choice test components.…

To determine if individuals other than first-line supervisors could be used as expert judges in making estimates of job performance worth when conducting a utility analysis, this study compared the estimates of experienced job incumbents with those of supervisors. The job class investigated was that of eligibility technician, who performs varied…