This guide will help researchers design and implement impact studies in education so that the findings are more generalizable to the study's target population. Guidance is provided on key steps that researchers can take, including defining the target population, selecting a sample of schools--and replacement schools, when needed--managing school…

Multilevel modeling (MLM) gives researchers the ability to make inferences about organizations where nesting factors will bias results and the assumption of independence is not tenable. This article provides an overview of the variety of data sources that lend themselves to conducting institutional research (IR). It not only serves as a repository…

This paper provides a guide to calculating statistical power for the complex multilevel designs that are used in most field studies in education research. For multilevel evaluation studies in the field of education, it is important to account for the impact of clustering on the standard errors of estimates of treatment effects. Using ideas from…

The Programme for International Assessment of Adult Competencies (PIAAC) will establish technical standards and guidelines to ensure that the survey design and implementation processes of PIAAC yield high-quality and internationally comparable data. This document provides a revised version of the technical standards and guidelines originally…

One purpose of educational research is to provide information about the likely impact of interventions or treatments on policy-relevant populations of students. Randomized experiments are useful for estimating the causal effects of interventions on the students in schools that participate in the experiments. Unfortunately, the samples of schools…

Two computer-intensive procedures are presented for dealing with non-random selection in the development of samples for experimental, quasi-experimental, and survey designs associated with educational research. The procedures are randomization tests to clarify treatment effects and bootstrap techniques to estimate the uncertainty of…

Present research connected with computer-based instruction indicates that many investigators rely on conventional experimental design and data analysis to address the research question. Although this is appropriate in many cases, the limits of hard and software resources and sample size in other cases have made conventional approaches a poor…

The serious problems associated with the use of stepwise methods are well documented. Various authors have leveled scathing criticisms against the use of stepwise techniques, yet it is not uncommon to find these methods continually employed in educational and psychological research. The three main problems with stepwise techniques are: (1)…

This report provides information from the 1982-83 School Utilization Survey, and examines school district wealth, school socioeconomic status (SES), and grade level in relation to the computer software available to teachers for instructional purposes, as well as teacher training for instructional use of computers. Teachers with access to computers…

This paper summarizes and highlights some of the critical developments, issues, and trends which impact the work of survey research. The issue of preventing or minimizing nonresponse bias by successfully obtaining cooperation from people being surveyed continues to be of concern to survey research professionals. The most effective response rate…

The "Handbook of Research on Electronic Surveys and Measurements" is the comprehensive reference source for innovative knowledge on electronic surveys. This commanding handbook of research provides complete coverage of the challenges associated with the use of the Internet to develop online surveys, administer Web-based instruments, and conduct…