The advantages of applying confirmatory factor analysis (CFA) to multitrait-multimethod (MTMM) data are widely recognized. However, because CFA as traditionally applied to MTMM data incorporates single indicators of each scale (i.e., each trait/method combination), important weaknesses are the failure to: (1) correct appropriately for measurement…

A framework is described for preparing process profiles of two different surveys conducted by the National Center for Education Statistics (NCES): the Recent College Graduates Survey and the Higher Education General Information Survey (HEGIS) Fall Enrollment Survey. The process profile examines the adequacy of the entire survey process, using…

This paper evaluates the logic underlying various criticisms of statistical significance testing and makes specific recommendations for scientific and editorial practice that might better increase the knowledge base. Reliance on the traditional hypothesis testing model has led to a major bias against nonsignificant results and to misinterpretation…

The sampling of teachers for nationwide surveys offers a challenging endeavor in obtaining a representative and adequate sample to truly represent opinions of the teachers. Ten national surveys of public school teachers conducted between 1980 and 1985 are presented with respect to their sampling design and procedures. Concepts and theoretical…

Previous studies of test item bias have investigated how different groups of examinees perform differently on a given set of items. These studies imply that examinees should be treated in a certain way because they are of a particular sex or race rather than as individuals in their own right, but it is unrealistic and unfair to assume such an…

This report provides the statistical tools necessary to measure the extent of error that exists in organizational record data and group survey data. It is felt that traditional methods of measuring error are inappropriate or incomplete when applied to organizational groups, especially in studies of organizational change when the same variables are…

The four main approaches to measuring treatment effects in schools; raw gain, residual gain, covariance, and true scores; were compared. A simulation study showed true score analysis produced a large number of Type-I errors. When corrected for this error, this method showed the least power of the four. This outcome was clearly the result of the…

Structural equation models incorporating unmeasured variables make possible the rigorous testing of theories previously difficult to test adequately because of fallible measures of the theoretic variables. This paper first discusses a simple causal model; incorporating a single unmeasured variable for the purpose of exposition. A substantive…

Scores on mental ability and academic skills for 1958 and 1978 of representative sample of grade 4 and 7 classes in Saskatchewan were compared. The selected students were administered appropriate levels of the Otis-Lennon Mental Ability Tests, and the Canadian Tests of Basic skills in vocabulary, reading, language skills (spelling, capitalization,…

The role that measurement error plays in the regression effect is discussed with particular reference to the RMC models for evaluating the effects of Elementary Secondary Education Act Title I programs. The norm referenced evaluation model assumes a theory of growth where the relative ranking of students remains the same from pretest to posttest…

In order to determine if Rasch Model procedures have any utility for equating pre-existing tests, this study reanalyzed the data from the equating phase of the Anchor Test Study which used a variety of equipercentile and linear model methods. The tests involved included seven reading test batteries, each having from one to three levels and two…

The first four chapters of this report primarily provide an extensive, critical review of the literature with regard to selected aspects of the criterion-referenced and mastery testing fields. Major topics treated include: (a) definitions, distinctions, and background, (b) the relevance of classical test theory, (c) validity and procedures for…

The statistical technique, "Zero-One Linear Programming," that has successfully been used to create multiple tests with similar characteristics (e.g., item difficulties, test information and test specifications) in the area of educational measurement, was deemed to be a suitable method for creating multiple sets of matched samples to be…

Education has become one of the most important issues in American society, often dominating the political landscape in response to lagging academic achievement and persistent gaps in performance between advantaged and disadvantaged children. In response, a variety of educational reforms have been implemented ranging from increased accountability…

Racial differences in the reporting accuracy of parental status characteristics by White and Black high school seniors were investigated using Joreskog's general framework for simultaneous covariance structure analyses of multiple populations. Reliability estimates for Whites were significantly higher than for Blacks due to differences in true…