Randomized experiments involving education interventions are typically implemented as cluster randomized trials, with schools serving as clusters. To design such a study, it is critical to understand the degree to which learning outcomes vary between versus within clusters (schools), specifically the intraclass correlation coefficient. It is also…

For more than four decades the National Assessment of Educational Progress (NAEP) has tracked the achievement of U.S. students in major academic subjects. This national resource is the only assessment that states and now many urban districts can look to as an objective yardstick of their performance over time, relative to national benchmarks, and…

E-learning researchers face considerable challenges in creating meaningful and generalizable studies due to the complex nature of this dynamic training medium. Our experience in conducting workplace e-learning research led us to create this guide for planning research on e-learning. We share the unanticipated complications we encountered in our…

Difficulties often encountered in conducting surveys in educational technology are described, and some guidelines are suggested for the design and implementation of a survey instrument. (RAO)

Discusses some practical issues in linking educational assessments, focusing on the importance of clarity of purpose when assessments are linked. Also stresses the importance of the design used to collect data for linking. Uses linking studies from a variety of situations to illustrate these points. (SLD)

In redesigning the data program of the National Center for Education Statistics (NCES), there is a need for standard definitions, constant vigilance against redundancy and excessive data collection, audits and verification on local school data and continued attention to equity results as well as excellence and achievement. Major test scores, such…

The sampling designs and procedures used by the National Assessment of Educational Progress in its second year assessment activities are documented. The report is organized in three parts. Project objectives and other background information are discussed in the first section. The details of the second year school and household samples are…

The effects of certain characteristics (e.g., sample design) of National Assessment of Educational Progress (NAEP) data on statistical analysis techniques are considered. Ignoring special features of NAEP data and proceeding with a standard analysis can produce inferences that underestimate the true variability and overestimate the true degrees of…

In January of 1987, a planning conference was convened by the Center for Education Statistics as part of an effort to study the feasibility of various approaches to the nationwide assessment of children's readiness for instruction in kindergarten and first grade. This report provides, in an appendix, the texts of the four commissioned papers…

This document describes a supplemental survey of staff in approximately half of the original sample of 1,015 schools that participated in the base year survey of the High School and Beyond Survey (HSB). The survey was designed to obtain measures of school goals and processes that effective schools literature indicates are important in achieving…

To assess the condition of American education in the next decade, the National Center for Education Statistics (NCES) should focus on collecting data in the following major areas: (1) the quality and quantity of time that is allocated to various activities in the classroom; (2) the concerns of teachers, including their working conditions and time…

This paper focuses on the mechanics of assessing the impact of educational technology. The basics of program evaluation, research design, data collection and analysis, and report generation are covered to provide useful information to those responsible for program evaluation research and to decision makers, who are the usual recipients of…

This workbook, which accompanies An Evaluation Primer (TM 007 500) consists of 19 practical exercises for applying evaluation skills to hypothetical educational programs. Each chapter corresponds to a chapter in the primer, with answers keyed accordingly. Intended to provide an introduction to evaluation, the exercises include: identifying the…

This manual has been produced to familiarize data users with the procedures followed for data collection and processing of the first follow-up component of the National Education Longitudinal Study of 1988 (NELS:88). A corollary objective is to provide the necessary documentation for use of the data file. Use of the data set does not require the…

This document includes invited papers written for the National Center for Education Statistics (NCES) Elementary/Secondary Education Data Redesign Project. Early in 1985, NCES began a thorough review of its data collection program. The purpose of the review was to address questions of the suitability, scope, reliability, and timeliness of…