Education systems are increasingly creating rich, longitudinal data sets with frequent, and even real-time, data updates of many student measures, including daily attendance, homework submissions, and exam scores. These data sets provide an opportunity for district and school staff members to move beyond an indicators-based approach and instead…

Background: Youth programs often rely on self-reported data without clear evidence as to the accuracy of these reports. Although the validity of self-reporting has been confirmed among some high school and college age students, one area that is absent from extant literature is a serious investigation among younger children. Moreover, there is…

While there has been some increasing interest in external validity, most work to this point has been in assessing the similarity of a randomized trial sample and a population of interest (e.g., Stuart et al., 2010; Tipton, 2011). The goal of this research is to calculate empirical estimates of the external validity bias in educational intervention…

Purpose: This policy brief, the second AERI-NEPC eBrief in the series "Understanding validity issues around the world", focuses on validity as it applies to test-based models of evaluation employed for schools, instructional programs, and teachers around the world. It discusses validity issues that could arise when data from student…

The purpose of this article is to demonstrate application of a new framework, the validation framework (VF), to assist researchers in evaluating mixed research studies. Based on an earlier work by Dellinger and Leech, a description of the VF is delineated. Using the VF, three studies from education, health care, and counseling fields are…

Research approaches in the field of transpersonal psychology can be transformative for researchers, participants, and the audience of a project. This book offers these transformative approaches to those conducting research across the human sciences and the humanities. Rosemarie Anderson and William Braud first described such methods in…

As lines between research paradigms continue to blur with the ever-increasing popularity of mixed methods research, there are useful, and occasionally oxymoronic, opportunities for educational researchers to juxtapose tools from opposing methods. The gold standard is just not possible in so much of what we do with small-scale research, nor is it…

Although definitions of validity have evolved considerably since L. J. Cronbach and P. E. Meehl's classic (1955) review, contemporary validity research continues to emphasize correlational analyses assessing predictor-criterion relationships, with most outcome criteria being self-reports. The present article describes an alternative way of…

This issue of "FOCUS" discusses external validity and what rehabilitation researchers can do to help practitioners answer the question "How far can we generalize this finding-- is it applicable to other clients/patients, with different characteristics, in dissimilar settings treated by other clinicians?," which clinicians and…

In this article, the author challenges the validity and usefulness of the concept of "paradigm," as this term has been used in the social sciences generally, and specifically in the debates over research methods. He emphasizes that in criticizing what he sees as the misuse of the paradigm concept, he is not arguing for dismissing or ignoring…

In this paper we described how we mixed research approaches in a Randomized Control Trial (RCT) of a school principal professional development program. Using examples from our study we illustrate how combining qualitative and quantitative data can address some key challenges from validating instruments and measures of mediator variables to…

As medical education research advances, it is important that education researchers employ rigorous methods for conducting and reporting their investigations. In this article we discuss several important yet oft neglected issues in designing experimental research in education. First, randomization controls for only a subset of possible confounders.…

This study was designed to determine the number of days of pedometer monitoring necessary to achieve reliable and valid estimates of a 1-year average of step counts in adults based on either consecutive days (CD) or random days (RD) of data collection. Twenty-three participants (16 women; M age = 38 years, SD = 9.9) wore a Yamax SW 200 pedometer…

Donald Campbell's approach to causal inference (D. T. Campbell, 1957; W. R. Shadish, T. D. Cook, & D. T. Campbell, 2002) is widely used in psychology and education, whereas Donald Rubin's causal model (P. W. Holland, 1986; D. B. Rubin, 1974, 2005) is widely used in economics, statistics, medicine, and public health. Campbell's approach focuses on…

Objective: This study presents evaluative data on the Childhood Experiences of Violence Questionnaire (CEVQ), a brief, self-report measure of youth victimization. Methods: Literature reviews, expert consultations and qualitative interviews informed the development of the CEVQ. Test-retest reliability of the preliminary and final versions of the…