Makerspaces, especially in their diverse proliferating forms, support a broad variety of learning outcomes. There is rich work in attempting to understand and describe these learning goals. Yet, there is a lack of support for practitioners and educators to assess the learning in events and programming at makerspaces (and similar environments)…

Propensity score matching and weighting methods are applied to balance covariates and reduce selection bias in the analysis of observational study data, and ultimately estimate a treatment effect. We wish to evaluate the impact of a Supplemental Instruction (SI) program on student success in an Introductory Statistics course. In such student…

Treatment fidelity assessment is critical to evaluating the extent to which interventions, such as the Good Behavior Game, are implemented as intended and impact student outcomes. The assessment methods by which treatment fidelity data are collected vary, with direct observation being the most popular and widely recommended. The current study…

The terms "outcome" and "impact" are ubiquitous in evaluation discourse. However, there are many competing definitions that lack clarity and consistency and sometimes represent fundamentally different meanings. This leads to profound confusion, undermines efforts to improve learning and accountability, and represents a…

In January 2014, I began working as an evaluator on an education reform project being implemented by faculty in science and engineering departments at my university. The core goals of the project were for participating faculty members to improve students' learning, engagement, and recruitment and retention in selected introductory-level courses…

High-quality, evidence-based professional development is essential to ensure that teachers obtain the knowledge, strategies and skills necessary to positively impact student learning. While the primary form of professional development, training has rarely been evaluated for quality beyond the satisfaction of those being trained. The Observation…

Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical…

The availability of effective research-based interventions and practices within schools is a growing concern within the field of education. There remains a lack of interventions that have been fully evaluated for use within schools and by school personnel, particularly in the area of social skills interventions. Understanding the need for social…

This study aimed at identifying the constraints to the application of self-assessment of the academic programmes at Al-Balqa Applied University (BAU) from the point of view of faculty members. The sample of the study consisted of (75) faculty members, who had experience in quality works and the self-assessment report, and the participants of the…

Efficacy studies of educational programs often involve mediator analyses aimed at testing empirically appropriate theories of action. In particular, in the studies of professional teacher development programs, the intervention targets presumably teacher performance while the ultimate outcome is the student achievement measured by a standardized…

The leadership of school principals is widely considered to have a strong influence on the quality of teaching and learning in schools. University-based leadership preparation programs have the responsibility for preparing candidates to serve as school principals and in other leadership capacities. This qualitative study of educational leadership…

States and districts can use this tool to create their own plans for continual improvement of an observation system, no matter where they are in their implementation. Included are action steps to improve observation rubrics, observer training, observer assessment, and monitoring. A planning process is described to assess current status, determine…

Our understanding of programs is enhanced when trained, skilled, and observant evaluators go "into the field"--the real world where programs are conducted--paying attention to what's going on, systematically documenting what they see, and reporting what they learn. The article opens by presenting and illustrating twelve reasons for…

Despite growing calls for more accountability of teacher education programs (TEPs), there is little consensus about how to evaluate them. This study investigates the potential for using observational ratings of program completers to evaluate TEPs. Drawing on statewide data on almost 9,500 program completers, representing 44 providers (183…

Effective teaching has long been an issue of national concern, but in recent years focus on the effectiveness of programs to produce high-quality teachers has sharpened. Long-standing achievement gaps persist despite large-scale legislative changes at the federal and state levels, and American students continue to show poorer performance on…