Despite the rising popularity of big data, there is speculation that evaluators have been slow adopters of these new statistical approaches. Several possible reasons have been offered for why this is the case: ethical concerns, institutional capacity, and evaluator capacity and values. In this method note, we address one of these barriers and aim…

Ethnography offers a holistic approach to qualitative researchers in educational contexts and appeals to scholars who wish seek to reveal rich narratives through their immersion in specific domains. This review paper examines the mobilization of the ethnographic research approach reported in studies from two distinctive learning contexts: an…

The two cross-national indices with gender-differentiated data introduced by the UNDP in 1995, as well as several other such indices developed subsequently, are an important resource for researchers and policy makers interested in gender disparities. Yet questions remain regarding how these indices should be interpreted and how valid they are.…

The examination of cross-classified category data is common in evaluation and research, with Karl Pearson's family of chi-square tests representing one of the most utilized statistical analyses for answering questions about the association or difference between categorical variables. Unfortunately, these tests are also among the more commonly…

To date, evaluation research and policy analysis have focused mainly on average program impacts and paid little systematic attention to their variation. Recently, the growing number of multi-site randomized trials that are being planned and conducted make it increasingly feasible to study "cross-site" variation in impacts. Important…

The commentaries on my article contain a number of points with which I disagree but also several with which I agree. For example, I continue to believe that the existence of many cases in which between-person variability does not increase with age indicates that greater variance with increased age is not inevitable among healthy individuals up to…

The aim of this article is to open discussion by analysing the cognitive reception of PISA in six European countries which were studied in the European collective research project KNOWandPOL (Knowledge and Policy in Education and Health Sectors). Reception does not mean here a simple vertical transmission of messages from the international level…

This article investigates three types of stage-sequential growth mixture models in the structural equation modeling framework for the analysis of multiple-phase longitudinal data. These models can be important tools for situations in which a single-phase growth mixture model produces distorted results and can allow researchers to better understand…

This article provides two illustrations of some of the factors that can influence findings from pre- and post-test research designs in evaluation studies, including regression to the mean (RTM), maturation, history and test effects. The first illustration involves a re-analysis of data from a study by Marsden (2004), in which pre-test scores are…

The current review addresses the validity of published meta-analyses in education that determines the credibility and generalizability of study findings using a total of 56 meta-analyses published in education in the 2000s. Our objectives were to evaluate the current meta-analytic practices in education, identify methodological strengths and…

Horner et al. (2005) present a review substantiating how single-subject research methodology can be utilized to determine whether interventions are evidence-based practices (EBPs). The current study utilized the Horner et al. research piece to: (a) systematically identify a set of quality standards for the evaluation of single-case research…

The purpose of this article is to develop guidelines to assist practitioners and researchers in evaluating and developing rigorous case studies. The main concern in evaluating a case study is to accurately assess its quality and ultimately to offer clients social work interventions informed by the best available evidence. To assess the quality of…

This action research study was conducted for purposes of changing the formal evaluation for school administrators to one constructed around the Interstate School Leaders Licensure Consortium (ISLLC) 2008 standards, inclusive of multifaceted components aimed to increase the active participation of both the evaluator and the individual being…

How can the average educator who teaches online, without experience in evaluating emerging technologies, build on what is successful and modify what is not? Written for educators who feel ill-prepared when required to evaluate e-learning initiatives, "Evaluating e-Learning" offers step-by-step guidance for conducting an evaluation plan of…

Qualitative researchers in school psychology have a multitude of analyses available for data. The purpose of this article is to present several of the most common methods for analyzing qualitative data. Specifically, the authors describe the following 18 qualitative analysis techniques: method of constant comparison analysis, keywords-in-context,…