As evidence-based interventions are scaled, fidelity of implementation, and thus effectiveness, often wanes. Validated fidelity measures can improve researchers' ability to attribute outcomes to the intervention and help practitioners feel more confident in implementing the intervention as intended. We aim to provide a model for the validation of…

Pragmatic measures of evidence-based practice (EBP) implementation can support and evaluate implementation efforts. We examined the predictive validity of therapist reports of EBP strategy delivery for children's mental health outcomes. Data were obtained from 1,380 sessions with 248 children delivered by 76 therapists in two county systems.…

Measuring the implementation fidelity (IF) or integrity of interventions is crucial, otherwise a positive or negative outcome cannot be interpreted. Direct and indirect methods of IF measurement tend to over-emphasize teacher behaviour. This paper focuses on IF measured by student behaviour collected through computers. Attainment was measured by…

PBIS is has been consistently correlated with reductions in student exclusion including suspensions, expulsions, poor attendance, and high school dropout rates. However, school-wide strategies that do not specifically involve effective instruction in academic areas are unlikely to result in increased academic achievement. To address this reality,…

This report analyzes the psychometric properties of the revised school-level SEL implementation rubric and the SEL specialists' activity log.

Over the last few decades, not only organizations but also Higher Education Institutions should be more responsive to the demands of the changed global business environment and improve their effectiveness. Our motivation to write this paper is to assess the implementation of an Enterprise Resource Planning (ERP) system in higher education and…

The purpose of this study was to examine the metacognitive awareness and the beliefs about mathematics teaching and learning of preservice elementary mathematics teachers and to explore the relationship between the two. The Metacognitive Awareness Instrument (MAI) and the Mathematics Beliefs Instrument (MBI) were implemented with 118 elementary…

Teachers are the primary implementers of social and emotional learning (SEL) programs. Their beliefs about SEL likely influence program delivery, evaluation, and outcomes. A simple tool for measuring these beliefs could be used by school administrators to determine school readiness for SEL programming and by researchers to better understand…

In this study, four years of formal observations of classroom teaching practice were employed to ascertain the practice fidelity of a site-based school reform in a secondary school setting. Those observations were then used as a criterion variable in an examination of differences in the perspectives of administrators, teachers and teaching peers…

Presented at the national conference for the American Educational Research Association (AERA) in 2009. This discussed the development and implementation of the new SAT writing section.

As school districts integrate evidence-based prevention programs into their daily regime, they may struggle with implementing these programs with fidelity. This is a multi-method, multi-source, retrospective explanatory study of the implementation factors associated with program installation and partial implementation of an evidence-based violence…

This paper illustrates the need for full description and measurement of differences between "experimental" and "control" situations in school program evaluation studies. Two studies were completed at the University of Oregon involving the innovative program--differentiated staffing (DS). The first study, a doctoral investigation, sought to assess…

A pilot project was designed to test the efficacy of profiling welfare recipients and referring them to welfare-to-work services targeted toward their specific work histories and skills. The general framework of Michigan's Work First program was used to illustrate how profiling can be designed and administered. A profiling model was proposed that…