Underlying all What Works Clearinghouse (WWC) products are WWC Study Review Guides, which are intended for use by WWC certified reviewers to assess studies against the WWC evidence standards. As part of an ongoing effort to increase transparency, promote collaboration, and encourage widespread use of the WWC standards, the Institute of Education…

This document provides step-by-step instructions on how to complete the Study Review Guide (SRG, Version S3, V2) for single-case designs (SCDs). Reviewers will complete an SRG for every What Works Clearinghouse (WWC) review. A completed SRG should be a reviewer's independent assessment of the study, relative to the criteria specified in the review…

Proactive preliminary minimum sample size determination can be useful for the early planning stages of a latent variable modeling study to set a realistic scope, long before the model and population are finalized. This study examined existing methods and proposed a new method for proactive preliminary minimum sample size determination.

Various measures for identifying the onset of babbling have been proposed in the literature, but a formal definition of the exact procedure and a thorough validation of the sample size required for reliably establishing babbling onset is lacking. In this paper the reliability of five commonly used measures is assessed using a large longitudinal…

In large-scale assessments, such as the National Assessment of Educational Progress (NAEP), plausible values based on Multiple Imputations (MI) have been used to estimate population characteristics for latent constructs under complex sample designs. Mislevy (1991) derived a closed-form analytic solution for a fixed-effect model in creating…

Three issues need to be decided in the design stage of a longitudinal intervention study: the number of persons, the number of repeated measurements per person, and the duration of the study. The degree to which polynomial effects vary across persons and the drop-out pattern also influence the statistical power to detect intervention effects. This…

Confidence intervals are widely accepted as a preferred way to present study results. They encompass significance tests and provide an estimate of the magnitude of the effect. However, comparisons of correlations still rely heavily on significance testing. The persistence of this practice is caused primarily by the lack of simple yet accurate…

Background: A literature search found five empirical studies of psychological treatment for adults with ADHD, out of 1,419 articles on ADHD in adults. Practice guidelines to date all recommend multimodal intervention, given that a significant number of patients cannot tolerate, do not respond to, or fail to reach optimal outcomes with medication…

The literature on measurement reliability shows the consensus that group heterogeneity with regard to the trait being measured is a factor that affects the sample measurement reliability, but the degree of such effect is not entirely clear. Sample performance also has the potential to affect measurement reliability because of its effect on the…

Suggest practical procedure for estimating number of subjects that need to be screened to obtain sample of fixed size that meets multiple correlated criteria. Procedure described is based on fact that least-squares regression provides good quadratic fit for Monte Carlo estimates of multivariate probabilities when they are plotted as function of…

The authors describe 2 efficiency (planned missing data) designs for measurement: the 3-form design and the 2-method measurement design. The 3-form design, a kind of matrix sampling, allows researchers to leverage limited resources to collect data for 33% more survey questions than can be answered by any 1 respondent. Power tables for estimating…

The purpose of this study was to develop a single procedure for comparing population variances which could be used for distribution forms. Bootstrap methodology was used to estimate the variability of the sample variance statistic when the population distribution was normal, platykurtic and leptokurtic. The data for the study were generated and…

Five-hundred dichotomously scored response patterns were generated with sequentially independent (SI) items and 500 with dependent (SD) items for each of thirty-six combinations of sampling parameters (i.e., three test lengths, three sample sizes, and four item difficulty distributions). KR-20, KR-21, and Split-Half (S-H) reliabilities were…

Background: Speaking rate has implications for both clinical practice and an understanding of normal and disordered communication processes. Fundamental information on speaking rate is required by the clinician for the appropriate management of those disorders with disturbances of rate or those in which rate modification strategies are applied.…

These tips on surveying public opinion are based on the contention that community surveys can be useful to educators who want to know what the community is thinking about education, are ready to respond, and have no qualms about making survey results public. The author first discusses the importance of determination of the community survey's…