A guide for professional counselors and counseling researchers for calculating and interpreting Percent Improvement as an indicator of clinical significance is provided. Strategies for reporting findings are described and illustrated. Guidelines for contextualizing discussions of clinical significance within the boundaries of psychometric evidence…

The field of education is increasingly committed to adopting evidence-based practices. Although randomized experimental designs provide strong evidence of the causal effects of interventions, they are not always feasible. For example, depending upon the research question, it may be difficult for researchers to find the number of children necessary…

Recent efforts to motivate parents' involvement in their child's literacy development involve informing parents about how to incorporate literacy development into daily routines. Teacher leadership and communication are critical--the more teachers encourage and assist parents and caregivers in supporting their child's literacy development, the…

This article challenges the idea that mixed methods research (MMR) constitutes a coherent research paradigm and explores how different research paradigms exist within MMR. Tracing paradigmatic differences at the level of methods, ontology, and epistemology, two MMR strategies are discussed: nested analysis, recently presented by the American…

Efforts to identify and support credible causal claims have received intense interest in the research community, particularly over the past few decades. In this paper, we focus on the use of statistical procedures designed to support causal claims for a treatment or intervention when the response variable of interest is dichotomous. We identify…

Multilevel modeling (MLM) gives researchers the ability to make inferences about organizations where nesting factors will bias results and the assumption of independence is not tenable. This article provides an overview of the variety of data sources that lend themselves to conducting institutional research (IR). It not only serves as a repository…

Donald Campbell's approach to causal inference (D. T. Campbell, 1957; W. R. Shadish, T. D. Cook, & D. T. Campbell, 2002) is widely used in psychology and education, whereas Donald Rubin's causal model (P. W. Holland, 1986; D. B. Rubin, 1974, 2005) is widely used in economics, statistics, medicine, and public health. Campbell's approach focuses on…

This paper is meant to highlight the occurrence of Simpson's Paradox when using aggregated data obtained from two IEA studies in Israel, while ignoring the effect of a powerful intervening variable in the local context--the ethnicity factor. It will demonstrate faulty conclusions regarding either the absence of relationships between a contextual…

Researchers, policy makers, and practitioners share a sincere interest in improving the human condition. Academics may be tempted to fault irrationality, ideology, or ignorance for the failure of research to inform policy and practice more powerfully, but policy makers and practitioners want academics to tell them "what works" in order to find a…

The nation is showing an unprecedented focus on increasing the rigor in education and preparing students for college. The college readiness trend is driving changes in the ways in which the nation uses student test data. Educational data are no longer limited to static data snapshots showing the status of a student performance at one point in…

This article describes the core features of outcome research and then explores issues confronting researchers who engage in outcome studies. Using an intervention research perspective, descriptive and explanatory methods are distinguished. Emphasis is placed on the counterfactual causal perspective, designing programs that fit culture and context,…

In Shadish (2010) and West and Thoemmes (2010), the authors contrasted 2 approaches to causality. The first originated in the psychology literature and is associated with work by Campbell (e.g., Shadish, Cook, & Campbell, 2002), and the second has its roots in the statistics literature and is associated with work by Rubin (e.g., Rubin, 2006). In…

Cluster randomized trials (CRTs) have been widely used in field experiments treating a cluster of individuals as the unit of randomization. This study focused particularly on situations where CRTs are accompanied by a common complication, namely, treatment noncompliance or, more generally, intervention nonadherence. In CRTs, compliance may be…

The purpose of this article is to demonstrate application of a new framework, the validation framework (VF), to assist researchers in evaluating mixed research studies. Based on an earlier work by Dellinger and Leech, a description of the VF is delineated. Using the VF, three studies from education, health care, and counseling fields are…

A central theme of research on human development and psychopathology is whether a therapeutic intervention or a turning-point event, such as a family break-up, alters the trajectory of the behavior under study. This article describes and applies a method for using observational longitudinal data to make more transparent causal inferences about the…