Trial-based functional analysis (TBFA) is an accurate and ecologically valid assessment of challenging behavior. Further, there is evidence to suggest that individuals with minimal exposure to behavior analytic assessment methodology (e.g., parents, teachers) can quickly be trained to conduct TBFAs in naturalistic settings (e.g., schools, homes).…

Program evaluation is important for assessing the implementation and outcomes of local, state, and federal programs. The Program Evaluation Toolkit provides tools and resources to support individuals responsible for evaluating and monitoring local, state, or federal programs. The toolkit comprises eight modules that cover critical steps in program…

Colleges and universities depend upon external approvals from accreditors, government agencies, and national organizations. These approvals require periodic review of institution-prepared reports and self-studies documenting the continued validity of offered degrees and programs, student support and success, institutional effectiveness, and…

Identifying effective literacy interventions for teachers of very young children is important, but it is not easy. In this case study, we share our experiences implementing a quasi-experimental evaluation of an early literacy program. We describe the design and context of the study and discuss three key issues that we encountered with data…

The "Examining Implementation and Outcomes of the Project On-Track High-Dosage Literacy Tutoring Program" study describes the characteristics of students who participated in a full year of Project On-Track, a high-dosage, small-group literacy tutoring program for students in grade 1-3. Its online adaptive program, Amplify Reading, groups…

This article examines factors that could have influenced whether evaluations of U.S. government--funded foreign assistance programs completed in 2015 had considered unintended consequences. Logit regression models indicate that the odds of considering unintended consequences were increased when all or most of seven standard data collection methods…

A mind mapping approach to evaluation called Ripple Effects Mapping (REM) has been developed and used by a number of Extension faculty across the country recently. This article describes three approaches to REM, as well as key differences and similarities. The authors, each from different land-grant institutions, believe REM is an effective way to…

"Measure, Use, Improve! Data Use in Out-of-School Time" shares the experience and wisdom from a broad cross-section of out-of-school time professionals, ranging from internal evaluators, to funders, to researchers, to policy advocates. Key themes of the volume include building support for learning and evaluation within out-of-school time…

Despite our best efforts as evaluators, program implementation failures abound. A wide variety of valuable methodologies have been adopted to explain and evaluate the "why" of these failures. Yet, typically these methodologies have been employed concurrently (e.g., project monitoring) or to the post-hoc assessment of program activities.…

Systematic direct observation (SDO) is frequently used in schools to document student response to evidence-based interventions, determine eligibility for special education services, and provide objective data during high-stakes decisions. However, there are several limitations associated with this widely used data collection tool including a…

With today's technology, Extension professionals have a variety of tools available for program evaluation. This article describes an innovative platform called VoiceThread that has been used in many classrooms but also is useful for conducting virtual focus group research. I explain how this tool can be used to collect qualitative participant…

The learning adaptation is a very important phase in a learning situation in human learning environments. This paper presents the authors' approach used to evaluate the effectiveness of learning adaptive systems. This approach is based on the analysis of learner satisfaction notices collected by a questionnaire on a learning situation; to analyze…

Charter schools exist under the umbrella of public education, but are not subject to the same level of public oversight or accountability measures as traditional public schools in North Carolina and many other states (BiFulco and Ladd, 2006, Bettinger, 2004). There is a lack of easily accessible efficiency data on charter schools. The primary aim…

The purpose of the "Drivers Best Practices Assessment" ("DBPA") is to assist organizations in assessing their current supports and resources for quality use of selected programs or practices. Specifically, organizations can use it to: (1) Identify strengths and opportunities for improvement in their current supports and…

A problem that has been the focus of much recent research in privacy preserving data-mining is the frequent itemset hiding (FIH) problem. Identifying itemsets that appear together frequently in customer transactions is a common task in association rule mining. Organizations that share data with business partners may consider some of the frequent…