The Vanderbilt Assessment for Leadership in Education (VAL-ED) is a 360-degree learning-centered behaviors principal evaluation tool that includes ratings from the principal, supervisors, and teachers. The current study assesses the test-retest reliability of the VAL-ED for a sample of seven school districts as part of multiple validity and…

Background/Context: The target of assessment validation is not an assessment but the use of an assessment for a purpose. Although the validation literature often provides examples of assessment purposes, comprehensive reviews of these purposes are rare. Additionally, assessment purposes posed for validation are generally described as discrete and…

This article concerns the contribution that feedback makes to valid classroom assessment of the writing of young learners (YLs), defined here as approximately 9-13 years old. It shows that a scale of descriptors adapted from the "Common European Framework of Reference for Languages" (CEFR; Council of Europe, 2001) can play a central role…

The state validation process in New York identifies promising practices developed through the Elementary Secondary Education Act Title IV-C funding. The new validation procedures included in this handbook are revised to: (1) make the evaluation process easier to apply; (2) provide technical assistance in evaluating the project; (3) extend…

The purpose of this paper is to review some of the methods used for the impact evaluation of Demonstrator-Developer projects and to promote the meta-analysis approach. Four examples of attempts to collect and analyze impact data from adopters are presented, one of which used the meta-analysis approach. In this example, each adopter collected pre…

Application review is the most important part of the Department of Education's funding process and is designed to ensure that projects are worthwhile and that awards are fair and impartial. The critical step in application review is competitive, objective evaluation by reviewers. This workbook was developed by the Department of Education to…

After surveying the nationwide trend toward reduction and re-evaluation of counselors, this report traces the development of a guidance program accountability evaluation process. The history, a basic definition and rationale of the program, and its goals are described. Various assessment tools, data evaluation and the resulting suggestions and…

The identification, validation, dissemination (IVD) process represents a quality control effort whose ultimate purpose is to validate and disseminate projects of proven educational quality and significance. The IVD and the Joint Dissemination Review Panel (JDRP) processes are complementary, although their procedures and criteria are distinct. JDRP…

This paper examines whether the peer-review process of the North Central Association (NCA) is reliable and valid. Reliance on peer judgments has been a part of NCA accreditation, but confidence in the use of peer decisions to certify a school's readiness to implement the improvement plan--Outcomes Accreditation (OA)--was weak. The study focused on…

The second of two related pamphlets, this guide describes how to design an outcome study and outlines procedures for collecting outcome data. After an introduction that delineates the purpose of the two-part series, the pamphlet is divided into four major sections. The first section explains how to select a cost-outcome analysis. The next three…

There is plentiful discussion about the importance of accountability, but much needs to be done to translate it into a manageable and credible system of ongoing feedback. In this book, evaluative inquiry is used in a way that balances attention between the investigation process and its purpose. The book is divided into three parts. Following an…

Three studies identifying the characteristics of program submittals approved by the Joint Dissemintion Review Panel were examined. Between 1978-1985, 358 demonstration programs were submitted. For each of these years, between 51 percent and 83 percent of the submittals were approved. In this study, the submittals were reviewed on the basis of the…

Citing the signaling and charged use distinction, examines federal expectations and need for evaluation data and extent of local capabilities to meet those expectations when secondary/transition model demonstration projects, funded by the Office of Special Education and Rehabilitation Services, were obligated to improve amount, quality, and use of…

Several validation methods for the identification and dissemination of exemplary educational programs are explored, and the rationales for methods developed by the Program Effectiveness Panel are discussed. Comparative advantages and disadvantages of four selected methods are reviewed, and recommendations are made for policymakers and…

Based on reviews of the final performance and evaluation reports of 81 career education projects funded by the U.S. Office of Education during 1976, this comprehensive report seeks to identify ways of making future evaluation efforts in this area more fruitful. The introduction consists of definitions of key terms and a clarification of the source…