In science in general and in the context of single-case experimental designs, replication of the effects of the intervention within and/or across participants or experiments is crucial for establishing causality and for assessing the generality of the intervention effect. Specific developments and proposals for assessing whether an effect has been…

This case study is based on a program evaluation of a professional certificate program that trains early childhood care and education providers to build and support young children's emotional literacy. The research project described in the case study will address approaches to methodological combination, justifying research design and changes to…

This article discusses the nonuse, misuse, and proper use of pilot studies in experimental evaluation research. The authors first show that there is little theoretical, practical, or empirical guidance available to researchers who seek to incorporate pilot studies into experimental evaluation research designs. The authors then discuss how pilot…

In 2007, I embarked on what turned out to be a 6-year-long PhD study that examined the leadership of teaching and learning through advice and information in school subject teams. Previous research had focused predominantly on formally designated leaders and their interactions with followers in informal contexts. My study focused on both formal and…

Reporting standards and critical appraisal tools serve as beacons for researchers, reviewers, and research consumers. Parallel to existing guidelines for researchers to report and evaluate group-comparison studies, single-case experimental (SCE) researchers are in need of guidelines for reporting and evaluating SCE studies. A systematic search was…

Researchers who are interested in asking a number of questions about a particular phenomenon are increasingly looking to mixed methods as a useful research approach. In this case study, we discuss how mixed-methods research is situated in current debates about quantitative and qualitative methods. Then, we provide some reasons as to why we, and…

This paper sets out to explore the perceptions of teachers towards assessment techniques at a secondary level private school of Karachi. This was conjectured on the basis of the circumstances of parallel boards in the education system of Pakistan and its effectiveness within the context with respect to the curriculum. This was gauged in line with…

Single-case designs are a class of research methods for evaluating treatment effects by measuring outcomes repeatedly over time while systematically introducing different condition (e.g., treatment and control) to the same individual. The designs are used across fields such as behavior analysis, clinical psychology, special education, and…

Systematic program evaluations of adolescent catechesis curricula are seldom completed and rarely published. This makes it very challenging to understand what is working and what is not. This case study describes the findings of a program evaluation of the Youth in Theology and Ministry curriculum of Saint John's School of Theology and Seminary in…

Purpose: This article provides a comprehensive narrative review of intervention studies for children with speech sound disorders (SSD). Its companion paper (Baker & McLeod, 2011) provides a tutorial and clinical example of how speech-language pathologists (SLPs) can engage in evidence-based practice (EBP) for this clinical population. Method:…

Randomized trials have experienced a marked surge in endorsement and popularity in education research in the past decade. This surge reignited paradigm debates and spurred qualitative critics to accuse these experimental designs of eclipsing qualitative research. This article reviews a current iteration of this debate and examines two randomized…

Background: A music education program with a goal of enhancing cognitive development of preschool-aged children enrolled in local preschools is evaluated by The Evaluation Center at Western Michigan University. The budget for the evaluation was small, and therefore presented several challenges to the evaluation team. Purpose: Through a case study…

Donald W. Compton, the first director of evaluation services at the National Home Office (Atlanta) of the American Cancer Society, tells the story of building the unit in conditions of high demand and a limited budget. Along the way, evaluation was brought to regional divisions and to local offices in part as a response to United Way and to his…

This article describes the design and evaluation approaches to address the complexity posed by systems change initiatives. The role of evaluations in addressing the following issues is briefly reviewed: moving from strategic planning to implementation, impacts on system-level coordination, anticipated timeline of impact, and individual level…

Single-case design and progress monitoring methodologies are efficient and cost-effective strategies for increasing accountability for indirect service provision. Single-case design conceptualizes the treatment of an individual as an experimental process that can be monitored over time and evaluated for effectiveness. Increasingly in clinical,…