Purpose: This policy brief, the second AERI-NEPC eBrief in the series "Understanding validity issues around the world", focuses on validity as it applies to test-based models of evaluation employed for schools, instructional programs, and teachers around the world. It discusses validity issues that could arise when data from student…

With the need to meet a set of higher accountability standards such as Interstate School Leaders Licensure Consortium (ISLLC) Standards and the AYP benchmarks of the NCLB Act, for example, school principals are faced with the knowledge that they play a vital role in school effectiveness as well as teacher retention, parent participation, and…

In this policy brief, the author explores the problems with attainment measures when it comes to evaluating performance at the school level, and explores the best uses of value-added measures. These value-added measures, the author writes, are useful for sorting out-of-school influences from school influences or from teacher performance, giving…

Analysis of the cost-effectiveness of 29 Comprehensive School Reform (CSR) models suggests that all 29 models are less cost-effective than an alternative approach for raising student achievement, involving rapid assessment systems that test students 2 to 5 times per week in math and reading and provide rapid feedback of the results to students and…

An invitation to explore innovative practices in program and system evaluation in a medium-sized school jurisdiction of approximately 11,000 students has resulted in a model with generative characteristics. This paper will describe the process, and several of the outcomes, when a generative evaluation approach is used to assess the effectiveness…

This paper reports on Oregon's Database Initiative Project (DIP). In response to inconsistent financial reports and a lack of automation, a project team was assembled by Oregon's Department of Education in 1997 with the goal of providing detailed school-level data for the 1997-98 school year in 16 Oregonian school districts. Among the project's…

This report summarizes the problems schools are encountering as they try to use data to gauge the effectiveness of standards-based education, accountability efforts, and school reform. It provides an overview of the education market, discusses the strengths and weaknesses of available software, and describes systems used by 19 states. The article…

Findings from an Employee Satisfaction Survey conducted in spring 2000 at Austin Community College (ACC) (Texas) indicate that: (1) staff in many areas need customer service training; (2) telephones are not used effectively by many offices; (3) many areas are not able to respond quickly to the needs of college staff; and (4) 18 highly used areas…

Research findings on school effectiveness are discussed in relation to an evaluation model that can be administered at the school and community level, comprising three kinds of data: (1) background factors, such as student social origin and level of attainment; (2) outcome factors; and (3) school process and climate factors. (SLD)

The development of the Tennessee school system Commissioner's Report Card (CRC) and the School Report Card--later named the Tennessee School Improvement Project (TSIP)--is described. The report card project began in 1984 when statewide mandated achievement testing was introduced. The first CRC included limited results of such testing. The first…

Process indicators (PIs) of school functioning and their place within the educational indicators systems are discussed. Literature is reviewed as a basis for selection of PIs for an integral model of school effectiveness. Although it is difficult to collect data on PIs, they provide valuable information on system functioning. (SLD)

Austin Community College mailed an Employee Satisfaction Survey in spring 2000 to 2,903 employees. The survey form asked respondents to rate college-wide and/or campus services that they had requested or received during the past year in terms of promptness, quality, attitude and overall service. The overall survey return rate was 15.4%, but rates…

Describes evaluation experiences in the Pittsburgh, Pennsylvania, School District. Suggests that use of evaluation results can be maximized through a systems approach that involves developing and monitoring different performance indicators, and tailoring educational practice by focusing corrective action on areas where performance is found to be…

Recommends that schools experiment with a comprehensive formative evaluation system suggested by "A Study of Schooling" by John Goodlad and his associates. The system includes periodic assessment of such things as student achievement, teaching practices, class climates, adult working environments, and parent attitudes. (Author/JM)

This document presents practical guidelines for evaluating community-based adult leaning projects in the United Kingdom to document their impacts. The guide provides frameworks, terms of reference, examples of methods used by community-based projects, ways of demonstrating project impact, and a range of evaluation tools. Sections 1 through 10…