This Workshop on Survey Methods in Education Research tool consists of a facilitator guide and workshop handouts. The toolkit is intended for use by state or district education leaders and others who want to conduct training on developing and administering surveys. The facilitator guide provides materials related to various phases of the survey…

This article summarizes results from 12 empirical evaluations of observational methods in education contexts. We look at the performance of three common covariate-types in observational studies where the outcome is a standardized reading or math test. They are: pretest measures, local geographic matching, and rich covariate sets with a strong…

We discuss collecting data simultaneously from many different instruments, including both qualitative and quantitative sources. A list of instruments used is provided, and data collection methods are described. Many practical logistical concerns are discussed, warning of potential pitfalls to be avoided. This article is intended to be a practical…

The present training study sought to determine if specific experimental procedures in paradigmatic language would cause differences in reading readiness test achievement among experimental, placebo, and control groups of beginning first-grade pupils. (Editor)

The pretest-posttest design referred to as Design 2 by Campbell and Stanley (1963) is commonly used in educational research and evaluation. The tenability of the assumption of a zero population difference commonly used with this design is questioned. A nonzero population estimate based on the mean difference observed in test-retest reliability…

The Panel on Decennial Census Methodology met during the year 1984 to investigate the following technical issues related to the 1990 United States census: (1) adjustment of census counts and characteristics; (2) sampling; and (3) administrative records. A number of recommendations were made. It was suggested that a low priority be given to…

The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…

Field tests of test items are useful in developing cutting scores for important tests, such as teacher certification examinations and high school graduation tests, because they indicate test item quality and estimate future examinee performance. However, field test data may provide a faulty indication of examinee performance on the real test.…

This paper contains a comparison of descriptive information based on analyses of pilot and live administrations of the Alabama High School Graduation Examination (AHSGE). The test is composed of three subject tests: Reading, Mathematics, and Language. The study was intended to validate the test development procedure by comparing difficulty levels…

The measurement of change is such a broad topic that this article must limit its focus to a few specific subtopics. These specific topics include: longitudinal research design, attrition in research studies, the statistical analysis of difference scores, and the comparison of analysis of variance (ANOVA) and multivariate analysis of variance…

This publication is primarily designed for educational practitioners who possess little or no training in conducting mail surveys or have not kept current on the present state of the art of survey methods and techniques. It is also intended to be a checking and comparing aid to ensure that important research considerations are taken into account.…

To meet several pre-evaluation goals of the national Emergency School Aid Act (ESAA) Evaluation study, the following activities that were undertaken are described: selection of an achievement measure; a pretest of this measure to assess student needs in schools eligible to receive funds under the Act (schools with a minority enrollment of 50…