This article, located in the discipline of academic literacy studies, draws upon the fields of critical realism, design research, and evaluation studies. It reports on the validation of a flexible evaluation design for assessing the impact of academic literacy interventions. The design was validated in two ways. Firstly, through a process of…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

Measuring classroom behavior among young children is important to guide assessment and intervention decisions, yet there is limited literature on appropriate direct observation tools for this purpose. This article describes the psychometric properties of the Behavior Assessment System for Children, Student Observation System (BASC-3 SOS) with 135…

Purpose: The aim of this study was to use the Daily Phonotrauma Index (DPI) to quantify group-based changes in the daily voice use of patients with phonotraumatic vocal hyperfunction (PVH) after receiving voice therapy as the sole treatment. This is part of an ongoing effort to validate an updated theoretical framework for PVH. Method: A…

The use of Simulation-Based Learning (SBL) has increased in Nutrition and Dietetic (N&D) programs, although the research supporting its usability in N&D students is lacking. There are limited quality SBL instruments available that have been validated and tested for reliability in N&D students preparing for clinical practice. This…

Auditory-visual conditional discrimination training (e.g., receptive identification training, listener responses; AVCD) is ubiquitous in early intervention and special education programs. Nevertheless, some learners with Autism Spectrum Disorder (ASD) do not appear to benefit from this training despite use of empirically validated treatments. To…

Educators commonly use school climate survey scores to inform and evaluate interventions for equitably improving learning and reducing educational disparities. Unfortunately, validity evidence to support these (and other) score uses often falls short. In response, Whitehouse et al. proposed a collaborative, two-part validity testing framework for…

Background: Accurate and meaningful assessment of language and communication skills to monitor child progress is the cornerstone to appropriate intervention for children with complex communication needs (CCN; Brady et al., 2016; Rowland et al., 2012). Despite this need, there is a lack of high quality and validated measurement of young children…

Comparative interrupted time series (CITS) designs evaluate impact by modeling the relative deviation from trends among a treatment and comparison group after an intervention. The broad applicability of the design means it is widely used in education research. Like all non-experimental evaluation methods however, the internal validity of a given…

In Japan, school teachers experience mental health issues, leading to absences or leave from their duties. While extended working hours significantly contribute to this problem, diminished self-esteem has emerged as the primary causal factor. Reduced self-esteem is frequently correlated with diminished self-efficacy across multiple facets of…

The social validity of behavior intervention is rooted in consumer perception. This information is typically garnered through questionnaires and interviews conducted with relevant consumers such as teachers or caregivers. Often, the participants (i.e., the individuals with disabilities receiving the intervention) play less of a role in the…

Naturalistic Developmental Behavioral Interventions (NDBIs) are evidence-based interventions implemented by the adults in a child's natural environment (e.g., by practitioners in classrooms). The social validity of this body of research may have an impact on the maintenance of practitioner implementation of NDBIs. We conducted a systematic review…

We sought to identify, examine, and summarize empirical literature focused on early childhood behavior interventions examined using a single case research designs (SCD) and published between 2001 and 2018. Using systematic procedures, 28 studies that met established inclusion criteria were identified, reviewed, and compared with respect to general…

The approaches of "problem-based learning" and "writing to learn" are known for facilitating the apprehension of concepts and better retaining of knowledge. In educational research, concept maps are sometimes used to assess the learners' level of knowledge. In this paper, the main aim is to investigate the validity of concept…

Tools for evaluating the quality and rigor of single case research designs (SCD) are often used when conducting SCD syntheses. Preferred components include evaluations of design features related to the internal validity of SCD to obtain quality and/or rigor ratings. Three tools for evaluating the quality and rigor of SCD (Council for Exceptional…