Underlying all What Works Clearinghouse (WWC) products are WWC Study Review Guides, which are intended for use by WWC certified reviewers to assess studies against the WWC evidence standards. As part of an ongoing effort to increase transparency, promote collaboration, and encourage widespread use of the WWC standards, the Institute of Education…

Designing your own study and writing your research proposal takes time, often more so than conducting the study. This practical, accessible guide walks you through the entire process. You will learn to identify and narrow your research topic, develop your research question, design your study, and choose appropriate sampling and measurement…

This document provides step-by-step instructions on how to complete the Study Review Guide (SRG, Version S3, V2) for single-case designs (SCDs). Reviewers will complete an SRG for every What Works Clearinghouse (WWC) review. A completed SRG should be a reviewer's independent assessment of the study, relative to the criteria specified in the review…

Internationally, the political appetite for educational measurement capable of capturing a metric of value for money and effectiveness has momentum. While most would agree with the need to assess costs relevant to quality to help support better governmental policy decisions about public spending, poorly understood measurement comes with unintended…

This article presents 3 standardized effect size measures to use when sharing results of an analysis of mediation of treatment effects for cluster-randomized trials. The authors discuss 3 examples of mediation analysis (upper-level mediation, cross-level mediation, and cross-level mediation with a contextual effect) with demonstration of the…

Purpose: The main aim of this paper is to develop guidelines on the critical issues to consider in research design in an action research (AR) environment for SME network capability development. Design/methodology/approach: The issues in research design for AR studies are developed from the authors' experience in running learning sets but, in…

The constraints of conducting evaluations in real-world settings often necessitate the implementation of less than ideal designs. Unfortunately, the standard method for estimating the precision of a result (i.e., confidence intervals [CI]) cannot be used for evaluative conclusions that are derived from multiple indicators, measures, and data…

Detecting early signs of autism is essential for timely diagnosis and initiation of effective interventions. Several research groups have initiated prospective studies of high-risk populations including infant siblings, to systematically collect data on early signs within a longitudinal design. Despite the potential advantages of prospective…

The authors use examples to illustrate how the design of a study conveys the overall strategy and soundness of the investigation. Elements of research design that are discussed include setting, subjects, sample, treatment, measurement, and communication of results. (CT)

A guide to survey research is presented for both novice and experienced researchers. Steps of the survey research process are covered: (1) planning the survey to determine the purpose of the study, collecting background information, designing the sample, and making a time line for completing the project; (2) questionnaire design, including the…

Discusses the effects of sampling scheme selection on the admissibility of log-linear models for multinomial and product multinomial sampling schemes for prospective and retrospective sampling. Notes that in multinomial sampling, marginal frequencies are not fixed, whereas for product multinomial sampling, uni- or multidimensional frequencies are…

A general framework for conducting generalizability analyses is presented. Generalizability theory is extended to situations in which the objects of measurement are not persons but other factors, such as instructional objectives, stages of learning, and treatments. (Author/PN)

This study comparing momentary time sampling against the real time obtained with handheld computers confirmed laboratory findings that short-elementary time sampling estimates percentage time accurately for a wide range of behavior frequencies and durations, and suggested that observers using momentary time sampling in a natural setting are able…

Since meta-analysis was described in 1976 (Glass) as the application of familiar experimental methods to the integration of available research, at least five coherent approaches to meta-analysis have appeared in common use. These approaches can be divided into two broad groups. In the first group (including procedures by Robert Rosenthal, Larry…

A set procedure developed in this study is useful in determining sample size, based on specification of linear contrasts involving certain formula treatments. (Author/DEP)