Three procedures for evaluating the sampling specificity of results are reviewed. These procedures are Tukey's jacknife technique, Efron's bootstrap technique, and cross-validation methods. The jacknife technique uses different subsamples derived from the original total data set to provide empirical estimates of the generalizability of effect…

This paper shares the findings of an inquiry that evaluated 50 survey articles published in a refereed journal, "Educational Administration Quarterly," by examining the 53 sample designs reported in the articles. The paper presents a typology of the sample designs identified, discusses the problems of sample selection and estimation…

Three criticisms of overreliance on results from statistical significance tests are noted. It is suggested that: (1) statistical significance tests are often tautological; (2) some uses can involve comparisons that are not completely sensible; and (3) using statistical significance tests to evaluate both methodological assumptions (e.g., the…

The effects of certain characteristics (e.g., sample design) of National Assessment of Educational Progress (NAEP) data on statistical analysis techniques are considered. Ignoring special features of NAEP data and proceeding with a standard analysis can produce inferences that underestimate the true variability and overestimate the true degrees of…

A general longitudinal model is presented for estimating school effects and their stability. The model, capable of separating true changes from sampling and measurement error, controls statistically for effects of factors exogenous to the school system. The model is illustrated with data from large cohorts of students in Scotland. (SLD)

This profile presents and summarizes available information about the quality of data from the five surveys that comprise the SASS, along with background material on the survey design and procedures for the following: (1) School Survey; (2) School Administrator Survey; (3) Teacher Demand and Shortage Survey; (4) Teacher Survey; and (5) Teacher…

A 1994 report, "Quality Profile for SASS, Aspects of the Quality of Data in the Schools and Staffing Surveys (SASS)," presented and summarized the available information about the quality of the data from the five surveys that made up the SASS in its first two rounds of data collection (1987-1988 and 1990-1991). This report updates the…

Procedures for obtaining student samples for the National Assessment of Educational Progress (NAEP) and deriving survey weights for analysis of survey data are described. Sample designs are economically and operationally feasible, and weighting procedures result in increased precision of estimates as they account for the probabilities of student…

Nonresponse issues are investigated for the base year (1988) survey of the United States Department of Education's National Education Longitudinal Study of 1988 (NELS:88), a national probability sample of middle schools and eighth-grade students in the spring of 1988. The total eighth-grade enrollment for the NELS:88 sample of schools was 203,002;…