Problems of obtaining a representative sample for a national survey are discussed, and the experiences of Educational Testing Service are used as examples of some methods used to cope with these problems. It is suggested that researchers: (1) capitalize on some existing program; (2) establish in the minds of the possible examinees and the possible…

Appendix A, "Data Analysis When Students Change from Smaller to Larger Schools between the Pre-test and Post-test of the First Year," discusses a methodological problem involved in planning the approximate number of questionnaires to be administered in program. Appendix B, "Estimates of Sample Sizes and Data Collection Costs," includes five…

Three common methodological problems in the analysis of observational data include: (1) failure to base degrees of freedom for the analysis on the appropriate sampling unit; (2) the validity of the design and data are inconsistent with the generalizations reached; (3) the statistic used to calculate coder reliability is often inappropriate and…

A general interest in attrition, or loss of units from a study, stems in part from the observation that the infrequency of attention to attrition exacerbates problems of data interpretation. As a substudy of the national evaluation of Project Follow Through, the potential biasing effects of attrition of subjects from the sites were investigated.…

To reduce problems in comparing gains in the rate of students who progress to the next level of education, a nonlinear transformation is recommended. Two such transformations, probits and logits, are presented. Log linear models are recommended for an appropriate statistical test of sampling error. (Author/GDC)

Examines in 13 articles, three areas of change in family research methodology. Considers major determinants of change in the subject matter of family studies. Addresses the central measurement problem of family studies, i.e., relationships. Presents illustrative examples of the advancement of research technologies in family studies. (RC)

The extent to which students with disabilities are represented in national data collection programs was investigated by reviewing nine such programs that are receiving attention in current educational reform initiatives. Results suggest that 40-50% of students with disabilities are excluded from these prominent data collection programs. (SLD)

A framework is described for preparing process profiles of two different surveys conducted by the National Center for Education Statistics (NCES): the Recent College Graduates Survey and the Higher Education General Information Survey (HEGIS) Fall Enrollment Survey. The process profile examines the adequacy of the entire survey process, using…

The sampling of teachers for nationwide surveys offers a challenging endeavor in obtaining a representative and adequate sample to truly represent opinions of the teachers. Ten national surveys of public school teachers conducted between 1980 and 1985 are presented with respect to their sampling design and procedures. Concepts and theoretical…

A method of adjusting for bias due to nonresponse to an alumni survey is demonstrated, based upon analysis of data from both on-time and late respondents. The responses are opinions of 254 alumni regarding how they rate their recently completed program of study within a college of an urban university. As part of the university's curriculum review…

Sample undercoverage issues in the National Education Longitudinal Study of 1988 (NELS:88) are addressed. The main focus is the exclusion of certain categories of student in the base year, 1988, and in in-school follow-up rounds. A subsidiary focus is the question of how adequately transfer students were captured within the sampling procedures of…

This paper examines how various equating methods are affected by: (1) sampling error; (2) sample characteristics; and (3) characteristics of anchor test items. It reviews empirical studies that investigated the invariance of equating transformations, and it discusses empirical and simulation studies that focus on how the properties of anchor tests…

Statistical significance is misused in educational and psychological research when it is applied as a method to establish the reliability of research results. Other techniques have been developed which can be correctly utilized to establish the generalizability of findings. Methods that do provide such estimates are known as invariance or…

Thirteen studies have evaluated the potential benefits from military training that individuals gain upon leaving active duty. Despite the fact that three-fourths of military jobs have direct civilian counterparts, most of these studies indicate that military training does not have a positive effect on the civilian job opportunities for veterans.…

While inquiry teaching has been a popular term in the social studies literature over the last decade, the empirical research appears to have paid little attention to specific inquiry models. All published papers and dissertations purporting to measure inquiry teaching for the five year period, January, 1967 through November, 1972 are reviewed and…