This article summarizes results from 12 empirical evaluations of observational methods in education contexts. We look at the performance of three common covariate-types in observational studies where the outcome is a standardized reading or math test. They are: pretest measures, local geographic matching, and rich covariate sets with a strong…

We discuss collecting data simultaneously from many different instruments, including both qualitative and quantitative sources. A list of instruments used is provided, and data collection methods are described. Many practical logistical concerns are discussed, warning of potential pitfalls to be avoided. This article is intended to be a practical…

The pretest-posttest design referred to as Design 2 by Campbell and Stanley (1963) is commonly used in educational research and evaluation. The tenability of the assumption of a zero population difference commonly used with this design is questioned. A nonzero population estimate based on the mean difference observed in test-retest reliability…

The Panel on Decennial Census Methodology met during the year 1984 to investigate the following technical issues related to the 1990 United States census: (1) adjustment of census counts and characteristics; (2) sampling; and (3) administrative records. A number of recommendations were made. It was suggested that a low priority be given to…

This paper contains a comparison of descriptive information based on analyses of pilot and live administrations of the Alabama High School Graduation Examination (AHSGE). The test is composed of three subject tests: Reading, Mathematics, and Language. The study was intended to validate the test development procedure by comparing difficulty levels…

The measurement of change is such a broad topic that this article must limit its focus to a few specific subtopics. These specific topics include: longitudinal research design, attrition in research studies, the statistical analysis of difference scores, and the comparison of analysis of variance (ANOVA) and multivariate analysis of variance…

To meet several pre-evaluation goals of the national Emergency School Aid Act (ESAA) Evaluation study, the following activities that were undertaken are described: selection of an achievement measure; a pretest of this measure to assess student needs in schools eligible to receive funds under the Act (schools with a minority enrollment of 50…