Program evaluation is an essential practice for providers of behavior analytic services, as it helps providers understand the extent to which they are achieving their intended mission to the community they serve. A proposed method for conducting such evaluations, is through the use of a consecutive case series design, for which cases are…

A model that maps the requisite skills, or knowledge components, to the contents of an online course is necessary to implement many adaptive learning technologies. However, developing a skill model and tagging courseware contents with individual skills can be expensive and error prone. We propose a technology to automatically identify latent…

Due to repeated observations of an outcome behavior in N-of-1 or single-case design (SCD) intervention studies, the occurrence of missing scores is inevitable in such studies. Approximately 21% of SCD articles published in five reputable journals between 2015 and 2019 exhibited evidence of missing scores. Missing rates varied by designs, with the…

Program evaluation is important for assessing the implementation and outcomes of local, state, and federal programs. The Program Evaluation Toolkit provides tools and resources to support individuals responsible for evaluating and monitoring local, state, or federal programs. The toolkit comprises eight modules that cover critical steps in program…

The "Integrated Approaches to Supporting Child Development and Improving Family Economic Security" project was conducted by Mathematica Policy Research and Northwestern University for the Office of Planning, Research and Evaluation (OPRE), in the Administration for Children and Families (ACF) at the U.S. Department of Health and Human…

In 2009, some Spanish regions implemented the Program School 2.0 with the purpose of introducing digital methodologies at schools. The aim of this paper is to analyse which part of the variation in reading scores is due to this program. For this purpose, we use data from the Program for International Student Assessment (PISA 2009 and 2012) for…

Increasingly, early education, regardless of setting type, is considered to be an educational intervention that sets the stage for children's long-term school success. Accordingly, policymakers are focused on how to develop and support educators who have the skills and capacity to deliver high-quality programming to children. A pressing question…

The use of an effective supervision mechanism is crucial between a student and supervisor. The essential knowledge shared and transferred between these two parties must be observed and understood very well in order to ensure that students are produced at good level of quality for future professional knowledge workers. The aim of this study was to…

As the use of educational technology becomes more ubiquitous, an enormous amount of learning process data is being produced. Educational data mining seeks to analyze and model these data, with the ultimate goal of improving learning outcomes. The most firmly grounded and rigorous evaluation of an educational data mining discovery is whether it…

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

This applied dissertation was designed to provide perceptual teacher data as well as summative testing data to educational leaders concerning the effects of implementing Investigations in Number, Data, and Space® (Investigations) in three Title I elementary school settings, two Title I schools, and one non-Title I school. Data collected during…

To date, evaluation research and policy analysis have focused mainly on average program impacts and paid little systematic attention to their variation. Recently, the growing number of multi-site randomized trials that are being planned and conducted make it increasingly feasible to study "cross-site" variation in impacts. Important…

The Pittsburgh Promise is a scholarship program that provides $5,000 per year toward college tuition for public high school graduates in Pittsburgh, Pennsylvania who earned a 2.5 GPA and a 90% attendance record. This study used a difference-in-difference design to assess whether the introduction of the Promise scholarship program directly…

This engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from them to evaluation practice. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for…

The growth in the availability of longitudinal data--data collected over time on the same individuals--as part of program evaluations has opened up exciting possibilities for evaluators to ask more nuanced questions about how individuals' outcomes change over time. However, in order to leverage longitudinal data to glean these important insights,…