Purpose: Linking Open Data (LOD) provides a vast amount of well structured semantic information, but many inconsistencies may occur, especially if the data are generated with the help of automated methods. Data cleansing approaches enable detection of inconsistencies and overhauling of affected data sets, but they are difficult to apply…

The evaluation of superintendents is one of the most important school board functions as it encapsulates expectations for the superintendent's performance and advancement toward district goals. Current and past literature devote little attention to the processes and outcomes of superintendent evaluations despite an apparent connection between…

Today, the term "quality" cannot be used without evidence--evidence of learning for teacher candidates, and evidence that these teachers impact their young learners. In response to this call for evidence, teacher education programs are currently developing assessment systems that emphasize the analysis of data to make educational decisions about…

Data from college admissions tests can provide a valuable measure of student achievement, but the non-representativeness of test-takers is an important concern. We examine selectivity bias in both state-level and school-level SAT and ACT averages. The degree of selectivity may differ importantly across and within schools, and across and within…

Evaluative statements from alumni have legitimacy with both internal and external stakeholders. Thus, alumni studies can provide valuable evidence of institutional effectiveness and lend themselves to both locally designed and commercial survey instruments for data collection. Under ideal conditions, the results of alumni studies equip faculty and…

The Office of Planning, Research and Evaluation (OPRE), a unit within the Administration for Children and Families (ACF), is responsible for advising the Assistant Secretary for Children and Families on increasing the effectiveness and efficiency of programs to improve the economic and social well-being of children and families. In collaboration…

As public and private funders have focused on evaluating the effectiveness of workforce development programs, a myriad of data collection systems and reporting processes have taken shape. Navigating these systems takes significant time and energy and often saps frontline providers' capacity to use data internally for program improvement.…

Although the Angoff procedure is among the most widely used standard setting procedures for tests comprising multiple-choice items, research has shown that subject matter experts have considerable difficulty accurately making the required judgments in the absence of examinee performance data. Some authors have viewed the need to provide…

A 10 year, longitudinal examination considered student performance for an Allied Health Distance Education (DE) program. The purpose was determining if students face-to-face in a classroom with an instructor performed differently than their counterparts located at a distance, taking class through an alternative delivery system. The question often…

In order to assess how completely a Small Learning Community (SLC) and/or Career Academy is implemented in any given site, and to connect the degree of implementation with the amount of improvement in student performance, two kinds of information are needed. The first is information on the quality of implementation, which can be collected by…

This chapter describes several examples of institutional use of state- and college-level tracking data to benchmark performance, improve student success, and enhance program effectiveness.

In consultation with experts in the fields of education research and whole school improvement, researchers at the Comprehensive School Reform Quality (CSRQ) Center created a framework for evaluating the scientific rigor of research studies that report on the efficacy of whole school improvement models. In this paper, the authors begin with a brief…

This chapter describes the National Student Clearinghouse and discusses opportunities and challenges for tracking community college students. It also presents a system perspective on using clearinghouse data to promote more comprehensive student and graduate tracking. (Contains 2 tables.)

Empowerment evaluation entered the evaluation lexicon in 1993. Since that time, it has attracted many adherents, as well as vocal detractors. A prominent issue in the debates on empowerment evaluation concerns the extent to which empowerment evaluation can be readily distinguished from other approaches to evaluation that share with it an emphasis…

This chapter examines lessons learned by states that are using student unit record (SUR) data to improve outcomes for community college students and recommends steps states can take to strengthen their use of SUR databases to benefit students and communities. (Contains 1 exhibit.)