This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

Meta-analytic reliability generalizations (RGs) are limited by the scarcity of reliability reporting in primary articles, and currently, RG investigators lack a method to quantify the impact of such nonreporting. This article introduces a stepwise procedure to address this challenge. First, the authors introduce a formula that allows researchers…

Calculating and reporting appropriate measures of effect size are becoming standard practice in psychological research. One of the most common scenarios encountered involves the comparison of 2 groups, which includes research designs that are experimental (e.g., random assignment to treatment vs. placebo conditions) and nonexperimental (e.g.,…

This article introduces a bootstrap generalization to the Modified Parallel Analysis (MPA) method of test dimensionality assessment using factor analysis. This methodology, based on the use of Marginal Maximum Likelihood nonlinear factor analysis, provides for the calculation of a test statistic based on a parametric bootstrap using the MPA…

Procedures are proposed for increasing the accuracy of generalization assessment in applied behavior analysis with behavior problem populations by accounting for the degree of natural covariation between treated and untreated behaviors. (Author/DB)

This paper identifies factors possibly influencing long-term effectiveness of social skills training with students having emotional or behavioral disorders. These include: lack of a sound conceptual framework, questionable social validity of target skills, controversies surrounding the nature of social skills deficits, imprecise assessment…

This study focused on the validation of Generalizable Reasoning Skills assessment instruments with students with disabilities in secondary vocational programs. Results indicated that student self-ratings, teacher ratings, and a performance test were internally consistent and precise measures of reasoning skills for some uses but that most…

This study evaluated a college level Introductory Psychology course taken by 23 precocious adolescents during a three-week summer residential program. This evaluation measured not only knowledge gain, but also understanding, generalization, and application of that knowledge. Immediate post measures of participants' knowledge, understanding, and…