The purpose of this paper is to prove that one currently recommended method of obtaining the reliability of an instrument defined on a population of aggregate units is invalid. This method randomly splits the aggregate into two halves, correlates the two half unit scores by a Pearson product moment correlation coefficient, and corrects the…

An original study with a 96 percent questionnaire return rate and four replications with high return rates were compared in terms of populations sampled, implementation, and results. Future use of this procedure, which includes advance mailing, telephone contact, telephone explanations, and followups, is discussed. (SLD)

The National Assessment of Educational Progress (NAEP) is a survey of the educational achievement of American students and changes in their achievement across time. The NAEP has collected information for over 20 years to assist educators and policy makers. This guide intends to: document current NAEP methods for both state and national…

The National Assessment of Educational Progress (NAEP), often called the "Nation's Report Card," is the only nationally representative, continuing assessment of what U.S. students know and can do in various subject areas. NAEP provides a comprehensive measure of students' learning at critical junctures in their school experience. The…

Research on assessing the cultural fairness of individual test items is reviewed, with emphasis on Birnbaum's three-parameter logistic model. As defined in this review, differential item characteristics are exhibited when examinees from one group have a lower probability of answering correctly than do examinees of equal ability from another group.…

Project TALENT, a large scale, long range, longitudinal study, is designed primarily to provide insights into the characteristics and development of American adolescents. In order to compare trends in test results, a comprehensive battery of Psychological, educational, and personality measures were administered to participants in the 1960, 1970,…

Six methods of equating Test of English as a Foreign Language (TOEFL) test scores for samples consisting of the usual groups of examinees and groups controlled for native language representation were evaluated in terms of scale stability. The equating methods included three item response theory (IRT) variants (fixed b's scaling, a one-parameter…

As mandated by Congress, the National Assessment of Educational Progress (NAEP) surveys the educational accomplishments of U.S. students and monitors changes in those accomplishments. NAEP tracks the educational achievement of 4th, 8th, and 12th graders over time in selected content areas, and has been tracking achievement for 30 years. The goals…

With the increasing globalization of human resources practices, a commensurate increase in demand has occurred for multi-language ("global") personality norms for use in selection and development efforts. The combination of data from multiple translations of a personality assessment into a single norm engenders error from multiple sources. This…

The National Assessment of Educational Progress (NAEP) is compared to the two studies of the National Educational Longitudinal Studies (NELS) Program--the National Longitudinal Study of the Class of 1972 (resurveyed in 1973, 1974, 1976, and 1979) and the 1980 High School and Beyond study (partially resurveyed and retested in 1982). The third phase…

Two previous meta-analyses of the test-coaching literature have yielded conclusions that differ with respect to aptitude test scores. This study attempts to resolve differences in the conclusions of these two analyses by J. A. Kulik, R. L. Bangert-Drowns, and C. L. C. Kulik (1984) and K. Pearlman (1984) by using the methods of F. L. Schmidt and J.…