As reporting of effect sizes in evaluation studies has proliferated, researchers and consumers of research need tools for interpreting or benchmarking the magnitude of those effect sizes that are relevant to the intervention, target population, and outcome measure being considered. Similarly, researchers planning education studies with social and…

The present guide provides a practical guide to conducting latent profile analysis (LPA) in the Mplus software system. This guide is intended for researchers familiar with some latent variable modeling but not LPA specifically. A general procedure for conducting LPA is provided in six steps: (a) data inspection, (b) iterative evaluation of models,…

BASIE is a framework for interpreting impact estimates from evaluations. It is an alternative to null hypothesis significance testing. This guide walks researchers through the key steps of applying BASIE, including selecting prior evidence, reporting impact estimates, interpreting impact estimates, and conducting sensitivity analyses. The guide…

The article serves as a guide for researchers in developing evidence of validity using bivariate correlations, specifically construct validity. The authors outline the steps for calculating and interpreting bivariate correlations. Additionally, they provide an illustrative example and discuss the implications.

Education systems are increasingly creating rich, longitudinal data sets with frequent, and even real-time, data updates of many student measures, including daily attendance, homework submissions, and exam scores. These data sets provide an opportunity for district and school staff members to move beyond an indicators-based approach and instead…

Multiple regression and correlation (MRC) methods form a flexible family of statistical techniques that can address a wide variety of different types of research questions of interest to rehabilitation professionals. In this article, we review basic concepts and terms, with an emphasis on interpretation of findings relevant to research questions…

Despite the best of intentions, qualitative researchers can be faced, in some circumstances, with having to make meaning from thin, or less than optimal, data. Using a real study as context, the authors describe the ways that they made sense of their thin data on teachers' perceptions of a large-scale evaluation instrument. They propose a…

The article examines the concepts of power and control in research design and applies them to a review of the validity of three studies (EC 600 064-066) evaluating the effectiveness of using Irlen tinted lenses with reading-disabled persons. Internal validity, external validity, statistical conclusion validity, and construct validity are…

This document examined studies of the overjustification effect. Many studies examining the phenomenon were conducted during the 1970s; findings appeared to be accepted without qualification. It is unclear whether researchers conducted the studies with the proper methodologies and interpreted results correctly. Such factors included the type of…

Theories of learning and instruction usually are grounded in psychological and epistemological assumptions. However, these theories ignore the child in relation to his or her cultural and institutional context and ignore the schoolteacher from the social context that regulates the process of transmission and acquisition of knowledge and skills.…

Asserts that policymakers and the general public should be well informed about economic and social issues. Contends that a statistical system in a democracy has a heavy responsibility to ensure that the data represent fact, not opinion. Discusses changes made in the Consumer Price Index to prevent it from becoming politicized. (CFR)

Provides a brief overview of single-subject research designs. This method exercises its power by examining changes in single subjects' responses over time across experimental conditions. Describes a classroom project in which students collect repeated measures of their own behavior and graph the data. (MJP)

Asserts that traditional approaches to multivariate analysis, including standard linear regression techniques, ignore the special character of count data. Explicates three suitable alternatives to standard regression techniques, a simple Poisson regression, a modified Poisson regression, and a negative binomial model. (MJP)

Argues that radical left-wing academics faced little opposition in their attempts to dominate intellectual theory in political science. Maintains that this occurred because quantitative research so displaced intellectual theory as to render it irrelevant. Describes the predominant emphasis on statistical methodology and paints a bleak picture of…

This guide is intended for local- and state-level vocational education administrators, planners, and evaluators who are responsible for making program planning and evaluation findings and decisions geared toward increasing program relevance. The method differs from more traditional approaches in its heavy reliance upon the selection and…