Objective: This article describes the evaluation of permanency roundtables, an intervention to help youth in foster care achieve legal permanency and the challenges evaluators faced in finding and using appropriate comparison data. Method: In 2009, permanency roundtables were conducted for 496 children in Georgia, most of whom had spent extended…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

Why do we continue to see evidence that nonprofit staff feel like outcome measurement is missing important aspects of their work? Based on an analysis of over 1,000 pages of material in 10 outcome measurement guides and a focused literature review of frontline work in three types of nonprofit organizations, this article shows that existing outcome…

In attempting to use a realistic evaluation approach to explore the role of Community Parents in early parenting programs in Toronto, a novel technique was developed to analyze the links between contexts (C), mechanisms (M) and outcomes (O) directly from experienced practitioner interviews. Rather than coding the interviews into themes in terms of…

Evaluating the impact of instructional innovations and coordinating instruction, assessment, and testing present complex tensions. Many evaluation and coordination efforts aim to address these tensions by using the coherence provided by modern cognitive science perspectives on domain-specific learning. This paper introduces an alternative…

In 2002, voters in Florida approved a constitutional amendment limiting class sizes in public schools to 18 students in the elementary grades, 22 students in middle grades, and 25 in high school grades. Analyzing statewide achievement data for school districts from 2004-2006 and for schools in 2007, this study purports to find that "mandated…

The Comparing Options in Secondary Mathematics: Investigating Curriculum (COSMIC) project is a longitudinal study of student learning from two types of mathematics curricula: integrated and subject-specific. Previous large-scale research studies such as the National Assessment of Educational Progress (NAEP) indicate that numerous variables are…

"How New York City's Charter Schools Affect Achievement" estimates the effects on student achievement of attending a New York City charter school rather than a traditional public school and investigates the characteristics of charter schools associated with the most positive effects on achievement. Because the report relies on an…

A broad set of ethical principles is examined to determine their relevance for evaluation. The five principles of K. S. Kitchener (autonomy, nonmaleficience, beneficence, justice, and fidelity) are relevant to evaluation and are fully represented in the evaluation standards of the Joint Committee on Standards for Educational Evaluation. (SLD)

The lack of consensus among researchers in defining the focal construct of rurality has led to contradictory conclusions of whether or not a rural-urban performance gap exists in higher education. Compounding this problem are the changing definitions of rural and urban, even among governmental agencies. Thus, this study used two different…

The study under review is the second-year evaluation report of the Milwaukee Parental Choice Program (MPCP), a publicly funded voucher program that allows low-income students in Milwaukee to attend secular and religious private schools in that city. Its primary finding is that there were no overall statistically significant differences in…

To explore the treatment fidelity of employee safety-belt programs, 614 organizations were divided into 2 groups: those that had (n=183), and those that had not (n=431) conducted an evaluation. Multiple regression analysis of associated data indicated that evaluation-active organizations were generally more active in other program areas. (TJH)

Survey items representing 30 standards of the Joint Committee on Standards for Educational Evaluation were used to examine violations in program evaluations. Twenty-nine novice graduate students, 57 graduate students with moderate knowledge about evaluation, and 61 expert evaluators viewed propriety and accuracy standards as suffering the most…

Program design can aid problem-solving or decision-making tasks faced by evaluators. It can be used to facilitate evaluation planning through the definition of program boundaries and the generation and focusing of evaluation questions. Further, it can provide evaluation information about theoretical, historical, and political contexts of a…

The history of the African people before slavery and colonization illustrates the ways in which different pictures of reality are created by which data are selected and ignored. The model of inquiry that verifies historical accuracy can help all program evaluators provide greater truth and equity for their clients. (SLD)