Even simple program theory evaluations could be used in meta-analysis to provide benefits. Explores several ways to combine program theory evaluation and meta-analysis, using a hypothetical model and an actual example from a federal funding program. Outlines four potential benefits to incorporating program theory evaluation into meta-analysis.…

Describe the role of an expert panel in setting priorities for evaluative work. An expert panel with high credibility inside and outside the organization that is at arms length to both the organization and external stakeholders can bypass many communications filters and provide a distilled and clear reading of stakeholder concerns. (SLD)

Presents a conceptual framework for putting program theory into operation. The framework incorporates variables that reflect theoretical concepts and implementation issues addressed in program evaluation. It organizes variables into input, process, and output categories. Discusses implications for program evaluation. (SLD)

Provides managers with specific guidance on developing and using logic models. For the last 20 years logic models have been used largely in program evaluations to chart what should have happened and what did or did not occur as intended. Logic models start with inputs and work through processes to the desired end state, whether output or outcome.…

Makes the case that both internal and external evaluation are needed in the assessment of educational systems. Suggests some conditions have to be met to establish a constructive dialogue between internal and external evaluation. (SLD)

Discusses the challenges facing foundations and offers a nine-part framework to suggest how an evaluation office can help foundations meet these challenges. The emphasis on capacity building is also of interest to organizations other than foundations. (SLD)

This study describes the web-based self- and peer-assessments system, or the Web-SPA, which has been shown to provide teachers with a flexible interface with which to arrange various self- and peer-assessment procedures. Secondly, this study examines the effects of the application of the progressively focused self- and peer-assessment (PFSPA)…

The evaluations of 26 career education programs which operated in the Philadelphia, Pennsylvania school district from July 1, 1975 to June 30, 1976 are contained in this report. Generally the projects achieved their objectives, with only a few exceptions. Indications are that the career development programs currently in progress in Philadelphia…

The 5-year impacts of mandatory welfare-to-work programs on welfare recipients and their children were examined by using a rigorous research design called a social experiment to examine 11 welfare-to-work programs in 6 states (California, Georgia, Michigan, Ohio, Oklahoma, and Oregon). Four employment-focused and seven education-focused programs…

There are numerous studies in literature related to the use of cartoons in physics, chemistry and mathematics education. However the studies on the use of cartoons as an alternative assessment tool are highly limited. This study was concerned with the use of cartoons as an alternative assessment method. There were five cartoons prepared related to…

What is the best use for tests? Testing should provide insight and information to educators and students. The primary purpose of testing is to inform teaching and learning. Yet, for too many schools, testing has been perverted to accommodate only measurement. Lesson plans are built around helping students pass the tests. In many instances, schools…

Program evaluation practices in early childhood care and education have been underdeveloped compared to the larger field of educational evaluation. The inclination not to include parental views in evaluation is mainly a result of the problem of positive response bias. Researchers who study client satisfaction with educational or child care…

The idea of a diagnostic process to identify students likely to benefit from additional support originated from two separate investigations relating to the performance of entry-level mathematics students at the University of South Africa (UNISA). One project explored the relationship between reading skill and mathematical performance. This…

This study investigates whether the functions linking number-correct scores to the College-Level Examination Program (CLEP) scaled scores remain invariant over gender groups, using test data on the 16 testlet-based forms of the CLEP College Algebra exam. To be consistent with the operational practice, linking of various test forms to a common…

Despite its importance as a central goal in environmental education, there appears to be little consensus about how best to document, assess and evaluate understanding of environmental concepts. This illustrative case study describes and demonstrates the use of the concept mapping strategy as an effective tool for assessing environmental…