This dissertation contributes to the discussion of what contributes to school district rankings in the state of Ohio. It uses Latent Profile Analysis to explore different variables at the contextual and district level as they correspond to Ohio's Performance Index academic measure and Value-Added academic measure. Results show that contextual…

Outreach activities have been an ongoing commitment of the American Chemical Society and other scientific organizations, yet formal assessment of outcomes has been infrequent. We have designed a simple, reliable, and robust format for assessing attitudinal and motivational characteristics of participants attending informal public events that…

We examined the extent to which mathematics program evaluations that have been conducted according to methodologically rigorous standards have attended to the theories underlying the programs being evaluated. Our analysis focused on the 37 reports of K-12 mathematics program evaluations in the last two decades that have met standards for inclusion…

School choice programs continue to be controversial, spurring a number of researchers into evaluating them. When possible, researchers evaluate the effect of attending a school of choice using randomized designs to eliminate possible selection bias. Randomized designs are often thought of as the gold standard for research, but many circumstances…

This article contributes to the body of knowledge on teacher evaluation systems by examining the actual design and performance of new teacher-evaluation systems in four school districts that are at the forefront of the effort to evaluate teachers meaningfully. The authors find first that the ratings assigned teachers by the districts'…

We conducted a content analysis of 27 assessment textbooks to determine how assessment planning was framed in texts for preservice teachers. We identified eight assessment planning themes: alignment, assessment purpose and types, reliability and validity, writing goals and objectives, planning specific assessments, unpacking, overall assessment…

Student feedback, test-score growth calculations, and observations of practice appear to pick up different but complementary information that, combined, can provide a balanced and accurate picture of teacher performance, according to research recently released from the Bill & Melinda Gates Foundation. A composite measure on teacher effectiveness…

The purpose of this study was to examine the impact of dimensionality, common-item set format, and different scale linking methods on preserving equity property with mixed-format test equating. Item response theory (IRT) true-score equating (TSE) and IRT observed-score equating (OSE) methods were used under common-item nonequivalent groups design.…

The Council for the Accreditation of Educator Preparation (CAEP) requires faculty from educator preparation programs to provide evidence of credential candidates' impact on K-12 student learning. However, there is a paucity of information on preparation programs' use of direct assessments of student learning to gauge credential candidate…

Background/Context: The target of assessment validation is not an assessment but the use of an assessment for a purpose. Although the validation literature often provides examples of assessment purposes, comprehensive reviews of these purposes are rare. Additionally, assessment purposes posed for validation are generally described as discrete and…

This paper provides practical guidance for researchers who are designing and analyzing studies that randomize schools--which comprise three levels of clustering (students in classrooms in schools)--to measure intervention effects on student academic outcomes when information on the middle level (classrooms) is missing. This situation arises…

The changing context of work and organizations is making new demands of leadership. Differing expectations on the goals of leadership training, and development are also emerging. To date, few comprehensive models to guide evaluation research and practice in the field of leadership training and development have appeared in the literature. This…

In the United States, but not only here, the movement to evaluate teachers based on student test scores has received powerful political and parental support. The logic is simple. From one testing occasion to another students should show growth in their knowledge and skill. Similar types of students should show similar patterns of growth. Those…

State education agencies and school districts are increasingly using measures based on student test-score growth in their systems for evaluating school and teacher performance. In many cases, these systems inform high-stakes decisions such as which schools to close and which teachers to retain. Performance metrics tied directly to student…

The aim of this chapter is to characterize educational reforms in Latin America over the last 25 years, and the way they reflect the role, method, and use of evaluation processes. The main theoretical and methodological tensions that are created by the development of evaluations will be reviewed, concluding with the identification of some of the…