Changing criterion designs (CCD) are single-case experimental designs that entail a step-by-step approximation of the final level desired for a target behavior. Following a recent review on the desirable methodological features of CCDs, the current text focuses on an analytical challenge: the definition of an objective rule for assessing the…

The Benefit Offset National Demonstration (BOND) tested a $1 reduction in benefits per $2 earnings increase above the level at which Social Security Disability Insurance benefits drop from full to zero under current law. BOND included a rare and large "population-representative" experiment: It applied the rule to a nationwide, random…

Skill in generating inferences predicts reading comprehension for students in the elementary and intermediate grades even after taking into account word reading, vocabulary knowledge, and cognitive ability (Cain et al., "Journal of Educational Psychology, 96," 671-81, 2004; Kendeou et al., "Journal of Research in Reading," 31,…

This meta-analysis provides an extensive and organized summary of intervention studies in education that are grounded in motivation theory. We identified 74 published and unpublished papers that experimentally manipulated an independent variable and measured an authentic educational outcome within an ecologically valid educational context. Our…

This chapter is a call for consequential education research that has transformative potential: intellectually, educationally, and socially. It is about learning to see differently. It is an argument about seeing our work with youth and communities in ways that can help education researchers see ingenuity instead of ineptness and inability, to see…

In this article, the authors examine the interconnections among education researchers' misconceptions about the quality of the education research literature. Specifically, the authors catalog the sequence of events that, when taken together with a series of contradictory graphs presented by influential scholars in prominent settings, may have…

Researchers have evaluated active support in agencies for persons with developmental disabilities to increase staff assistance and service user engagement. A systematic review identified two studies in which researchers reported three experimental evaluations of active support. Only one experiment showed a clear functional relationship between…

This chapter provides a selective review of some contemporary approaches to program evaluation. One motivation for our review is the recent emergence and increasing use of a particular kind of "program" in applied microeconomic research, the so-called Regression Discontinuity (RD) Design of Thistlethwaite and Campbell (1960). We organize our…

Use of multivariate analysis (e.g., multivariate analysis of variance) is common when normally distributed outcomes are collected in intervention research. However, when mixed responses--a set of normal and binary outcomes--are collected, standard multivariate analyses are no longer suitable. While mixed responses are often obtained in…

Default options exert an influence in areas as varied as retirement program design, organ donation policy, and consumer choice. Past research has offered potential reasons why no-action defaults matter: (a) effort, (b) implied endorsement, and (c) reference dependence. The first two of these explanations have been experimentally demonstrated, but…

In recent years, some researchers have examined motor learning in older adults. Some of these studies have specifically looked at the effectiveness of different manipulations of extrinsic feedback, or knowledge of results (KR). Given that many motor tasks may already be more challenging for older adults compared to younger adults, making KR more…

The sense that replicability is an important aspect of empirical science led Killeen (2005a) to define "p[subscript rep]," the probability that a replication will result in an outcome in the same direction as that found in a current experiment. Since then, several authors have praised and criticized 'p[subscript rep]," culminating…

This paper analyzes 12 recent within-study comparisons contrasting causal estimates from a randomized experiment with those from an observational study sharing the same treatment group. The aim is to test whether different causal estimates result when a counterfactual group is formed, either with or without random assignment, and when statistical…

Models of a psychological process can be difficult to discriminate experimentally because it is not easy to determine the values of the critical design variables (e.g., presentation schedule, stimulus structure) that will be most informative in differentiating them. Recent developments in sampling-based search methods in statistics make it…

This paper reports a systematic literature review examining empirical studies on the effects of peer assessment for learning. Peer assessment is fundamentally a social process whose core activity is feedback given to and received from others, aimed at enhancing the performance of each individual group member and/or the group as a whole. This makes…