Researchers have raised a number of questions about whether student achievement data can be used fairly or accurately for purposes of teacher evaluation. Others have noted that achievement data alone cannot provide teachers with the information they need to improve their practice. Recognizing these limitations, the federal government and many…

The results of an evaluation of Vermont's statewide assessment initiative are presented, with information about the implementation of the program, its effects on educational practice, the analytic challenge presented by the portfolio scoring process, the reliability and validity of portfolio scores, and the tensions between assessment and…

Five papers presented at a symposium during the 1991 annual conference of the National Council on Measurement in Education explore the design, development, and implementation of the Texas Master Teacher Examination (TMTE) Program. Educational policymakers have begun to maintain that the professionalization of teaching can be substantially…

Accuracy in the scoring of writing is critical if standardized tasks are to be used in a national assessment scheme. Three approaches to establishing accuracy (i.e., consensus, consistency, and measurement) exist and commonly large-scale assessment programs of primary school writing demonstrate adjacent agreement consensus rates of between 80% and…

Quality measures were originally developed for research aimed at describing the settings that children spend time in and identifying the characteristics of these environments that contribute to children's development. They were also developed to guide improvements in practice. Increasingly, however, measures of quality are being used for further…

This handbook has been prepared to address one specific problem: How can the techniques of program evaluation be effectively applied to produce useful information about the operations and impact of moral education programs in secondary schools? The handbook is divided into five chapters. The introductory chapter describes the background and…

In 1997, Head Start launched the Family and Child Experiences Survey (FACES), a study of a national random sample of Head Start programs, designed to describe characteristics, experiences, and outcomes for children and families served by Head Start. In 2000, FACES began data collection on a new national cohort of 2,800 children and their families…

This study elaborates the "what works?" question by exploring the effects of variability in program implementation quality on achievement. Particularly, the effects on achievement of computerized assessment of reading were investigated, analyzing data on 51,000 students in Grades 1-12 who read over 3 million books. When minimum implementation…

A study at Brigham Young University (Utah) investigated the feasibility of computer-assisted language placement testing in higher education. Benefits and problems of this approach for test administration, individualization of item selection, and recordkeeping were examined. Four steps were followed in production of a test for Spanish placement:…

This document contains the executive summary and the detailed report which provide an independent evaluation of Kentucky's new system for assessing student performance, the Kentucky Instructional Results Information System (KIRIS). The summary gauges progress to date, highlights some strengths to be built on and problems to be solved, and provides…

Participants in this conference of educators, convened to consider methods of evaluating teacher education students, focused upon the relationship between candidate quality and teacher effectiveness. Questions under consideration included: (1) pre-admission field experiences students should demonstrate; (2) optimum scores on aptitude and…

A dual screening device for teacher preparation programs was mandated by the Texas legislature in 1981. The two requirements included passing an entrance examination upon application to a teacher education program, and passing a proficiency examination upon completion of the program. The state must produce competent, well-prepared teachers; train…

This is the sixth and final report of the National Research Council's Committee on the Performance of Military Personnel on the Joint-Service Job Performance Measurement/Enlistment Standards (JPM) Project, a project designed to develop measures of performance for entry-level military jobs so that enlistment standards could be linked to performance…

The "No Child Left Behind Act" of 2001 crystallized the concern for accountability in education. National testing was mandated as a way to improve the "broken" educational system. Publicly funded early education programs were not spared from such testing. While the positive effects of high-quality early education on children's…

This paper focuses on ways in which one state policy for improving education--standard-setting through testing mechanisms--affects the classroom teacher-learner relationship. That uniform policy-making is problematic is clear from observations of 43 Mid-Atlantic school district teachers. Responding to three types of standards, 45 percent found…