Makerspaces, especially in their diverse proliferating forms, support a broad variety of learning outcomes. There is rich work in attempting to understand and describe these learning goals. Yet, there is a lack of support for practitioners and educators to assess the learning in events and programming at makerspaces (and similar environments)…

Propensity score matching and weighting methods are applied to balance covariates and reduce selection bias in the analysis of observational study data, and ultimately estimate a treatment effect. We wish to evaluate the impact of a Supplemental Instruction (SI) program on student success in an Introductory Statistics course. In such student…

Treatment fidelity assessment is critical to evaluating the extent to which interventions, such as the Good Behavior Game, are implemented as intended and impact student outcomes. The assessment methods by which treatment fidelity data are collected vary, with direct observation being the most popular and widely recommended. The current study…

The terms "outcome" and "impact" are ubiquitous in evaluation discourse. However, there are many competing definitions that lack clarity and consistency and sometimes represent fundamentally different meanings. This leads to profound confusion, undermines efforts to improve learning and accountability, and represents a…

In January 2014, I began working as an evaluator on an education reform project being implemented by faculty in science and engineering departments at my university. The core goals of the project were for participating faculty members to improve students' learning, engagement, and recruitment and retention in selected introductory-level courses…

High-quality, evidence-based professional development is essential to ensure that teachers obtain the knowledge, strategies and skills necessary to positively impact student learning. While the primary form of professional development, training has rarely been evaluated for quality beyond the satisfaction of those being trained. The Observation…

Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical…

The availability of effective research-based interventions and practices within schools is a growing concern within the field of education. There remains a lack of interventions that have been fully evaluated for use within schools and by school personnel, particularly in the area of social skills interventions. Understanding the need for social…

This study aimed at identifying the constraints to the application of self-assessment of the academic programmes at Al-Balqa Applied University (BAU) from the point of view of faculty members. The sample of the study consisted of (75) faculty members, who had experience in quality works and the self-assessment report, and the participants of the…

The leadership of school principals is widely considered to have a strong influence on the quality of teaching and learning in schools. University-based leadership preparation programs have the responsibility for preparing candidates to serve as school principals and in other leadership capacities. This qualitative study of educational leadership…

Despite growing calls for more accountability of teacher education programs (TEPs), there is little consensus about how to evaluate them. This study investigates the potential for using observational ratings of program completers to evaluate TEPs. Drawing on statewide data on almost 9,500 program completers, representing 44 providers (183…

Research Findings: The Early Childhood Environment Rating Scale-Revised (ECERS-R) is widely used, often to evaluate whether preschool programs are of sufficient quality to improve children's school readiness. We examined the validity of the measure for this purpose. Item response theory (IRT) analyses revealed that many items did not fit together…

Research Findings: The Early Childhood Environment Rating Scale, Revised (ECERS-R) is widely used, often to evaluate whether preschool programs are of sufficient quality to improve children's school readiness. We examined the validity of the measure for this purpose. Item response theory (IRT) analyses revealed that many items did not fit together…

Practicum is the cornerstone of teacher education. Triadic assessment of practicum is an established model in early childhood initial teacher education in New Zealand. Based on a phenomenographic study on assessment of practicum, this paper presents a new perspective on triadic assessment. Interview data are collected from 35 participants (20…

Observational assessment is used to study program and teacher effectiveness across large numbers of classrooms, but training a workforce of raters that can assign reliable scores when observations are used in large-scale contexts can be challenging and expensive. Limited data are available to speak to the feasibility of training large numbers of…