Educational researchers commonly use the rule of thumb of "design effect smaller than 2" as the justification of not accounting for the multilevel or clustered structure in their data. The rule, however, has not yet been systematically studied in previous research. In the present study, we generated data from three different models…

Problems associated with randomization tests in single- case experiments are discussed. This article follows a discussion of randomization tests in single case studies in the same issue of this journal. (See TM 505 799; 505 801).(Author/JKS)

This book is designated for an audience of the practitioners of education, especially those located in elementary schools. It is designed to investigate and explain research methods, terms, and concepts so that the reader can narrow down the many ways things are known or said to be known. Included in this book are chapters on the research process…

This paper discusses the problems of gathering and analyzing data on classroom behaviors. The difficulties involved in using the common pretest-posttest experimental design are described. To grapple with these problems, a study was conducted on the effect of environmental changes on student behavior, employing a time-series design and time-series…

Both administratively and in terms of their evaluations, Head Start and Follow Through have been treated as separate programs. Follow Through was initially conceived, however, as an effort to preserve and augment Head Start gains. In this report, achievement test data on a set of children who participated in both Head Start and Follow Through are…

Problems of obtaining a representative sample for a national survey are discussed, and the experiences of Educational Testing Service are used as examples of some methods used to cope with these problems. It is suggested that researchers: (1) capitalize on some existing program; (2) establish in the minds of the possible examinees and the possible…

MEMBERS OF THE EVALUATION SECTION OF HARVARD PROJECT PHYSICS, DESCRIBING WHAT IS SAID TO BE THE FIRST ATTEMPT TO SELECT A NATIONAL RANDOM SAMPLE OF (HIGH SCHOOL PHYSICS) TEACHERS, LIST THE STEPS AS (1) PURCHASE OF A LIST OF PHYSICS TEACHERS FROM THE NATIONAL SCIENCE TEACHERS ASSOCIATION (MOST COMPLETE AVAILABLE), (2) SELECTION OF 136 NAMES BY A…

Methodological challenges associated with structural equation modeling (SEM) and structured means modeling (SMM) in research on school violence and related topics in the social and behavioral sciences are examined. Problems associated with multiyear implementations of large-scale surveys are discussed. Complex sample designs, part of any…

At the request of the Office of the Assistant Secretary for Educational Research and Improvement, the Panel to Evaluate the National Center for Education Statistics (NCES) was established in 1985 by the National Academy of Sciences. This report culminates an extensive two-year study of NCES and reflects the panel's broad view of the center's…

As in any very large survey, the sample that provided data for the National Longitudinal Study of the High School Class of 1972 (NLS) differed from the random sample of the study design because of nonresponse from 226 of the 1,200 schools in the primary sample, and a small amount of other missing data. Part A of this report, briefly describes the…

The establishment of Research and Instructional (R and I) Units is discussed in terms of their utility and applicability for research needs. These units are said to provide a propitious setting for rigorous educational research. Two experiments in R and I units are described--one dealing with ways to implement feedback to students on their school…