This paper describes several situations in which generalization of statistical results is not possible by representative sampling but which is attempted using corrections for selection of groups. The situations include hiring, admissions, differential classification, guidance, test score equating, and test score scaling. Evidence of inaccuracies…

Four main approaches to customized testing are described, and their resulting scores' valid uses and interpretations are discussed. Customized testing can yield valid normative and curriculum-specific information, although cautious application is needed to avoid misleading inferences about student achievement. (SLD)

The need for scale linking in the National Assessment of Educational Progress (NAEP) is discussed, and the specific procedures used to carry out the linking in the context of the major analyses of the 1990 NAEP mathematics assessment are described. Issues remaining to be addressed are outlined. (SLD)

Effects of passage and item-scrambling on equipercentile and item-response theory equating were investigated using 2 scrambled versions of the American College Testing Program Assessment for approximately 25,000 examinees. Results indicate that using a base-form conversion table with a scrambled form affects the individual examinee level. (SLD)

Item parameter estimates derived through item response theory methods have been considered relatively robust to changes in item position and context, but the anomaly in reading scores from the 1986 National Assessment of Educational Progress (NAEP) illustrates problems with common population equating procedures when there are test form changes.…

Although few question the positive impacts alternative forms of assessment can have on instruction, concerns about the psychometric quality of data obtained from such assessments are taking their toll. Scoring issues are at the heart of many of these concerns. This paper addresses the causes of these concerns: misinformation about psychometric…

Three different item-bank maintenance procedures were compared for the purpose of investigating their cumulative effects on a series of longitudinal equatings of tests measuring the same characteristic. Item data used resulted from Rasch one-parameter latent trait test calibrations. Comparison of the results in the various final banks were made.…

The efficacy of employing subsets of items from a calibrated item pool to estimate the Rasch model person parameters was investigated. Specifically, the degree of invariance of Rasch model ability-parameter estimates was examined across differing collections of simulated items. The ability-parameter estimates were obtained from a simulation of…

Score equity assessment was used to evaluate linkings of new SAT® to the current SAT Reasoning Test™. Population invariance across gender groups was studied on the linkage of a new SAT critical reading prototype to a current SAT verbal section, and on the linkage of a new SAT math prototype to a current SAT math section. The results indicated that…

In response to growing frustration over the lack of information about the national effectiveness of the Chapter 1 program, Congress enacted the Education Amendments of 1974. Section 151 of the Amendments directed the U.S. Office of Education to develop evaluation models that would allow school district data to be aggregated to provide national…

As part of a longitudinal study of the growth of general medical knowledge among osteopathic medical students, a simple, convenient, and accurate vertical equating method was developed for constructing a scale for medical achievement. It was believed that Parts 1, 2, and 3 of the National Board of Osteopathic Medical Examiners' (NBOME) examination…

The viability of the Partial Credit Model (PCM) of G. N. Masters (1982) for scaling and banking individual essay prompts from a statewide writing assessment program was investigated. Preliminary analyses indicated the feasibility of using the PCM, the general polychotomous form of the Rasch model, with essay data from the Maryland Writing Test…

Statistical equating of scores from direct writing assessments is performed in Maryland to hold the difficulty of passing the Maryland Writing Test (MWT) equivalent from year to year and to allow a demonstration of growth in student writing achievement over the years. Passage of the test is a high school graduation requirement. Prior to…

This Technical Report provides descriptions and summary data that assist measurement specialists in assessing the procedures used in developing New Jersey's High School Proficiency Test (HSPT), the technical qualities of the tests, and the statewide results obtained from its use. The data summarized in this report were collected during the various…

Intended primarily for local education agency evaluators and state education policy makers, this paper explores several technical and policy issues related to the use of non-normed tests in the Elementary and Secondary Education Act Title I Evaluation and Reporting System (TIERS). The technical issues discussed were: (1) the assumption, necessary…