Best linear prediction (BLP) and penalized best linear prediction (PBLP) are techniques for combining sources of information to produce task scores, section scores, and composite test scores. The report examines issues to consider in operational implementation of BLP and PBLP in testing programs administered by ETS [Educational Testing Service].

A statistical model is proposed that describes the determination of an educational outcome variable as a nonlinear function of explanatory variables defined at different levels of a survey data hierarchy, such as students and classes. The theoretical and practical derivation of the model is discussed, and an example is given. (Author/BW)

To evaluate test speededness and to derive implications for test program activity, this study reviewed the literature on speed and power, identifying four major approaches to the assessment of speed: the Gulliksen approach, the Cronbach and Warrington approach, the Stafford approach, and the approach of the Educational Testing Service (ETS) as…

False positive and false negative error rates were studied for competency testing when failing examinees are permitted to retake the test. Formulas are provided for the beta-binomial and Rasch models. Estimates based on these models are compared for six data sets from the South Carolina Basic Skills Assessment Program. (SLD)

This paper outlines a methodology that school districts can use to enhance the presentation of district-wide testing program results to administrators, school boards, teachers, and the public. Based on John Tukey's two way analysis methodology, it involves fitting this model: test score equals overall plus year plus grade plus cohort plus…

The National Board of Medical Examiners uses the Rasch model to calibrate test items, maintain item banks, equate scores, and monitor the consistency of examiner item response patterns. The model is also being used in the study of patient management problems examinations, standard-setting, and computer-based examinations. (Author/BS)

The feasibility of using item response theory (IRT) as a psychometric model for the Graduate Record Examination (GRE) Aptitude Test was addressed by assessing the reasonableness of the assumptions of item response theory for GRE item types and examinee populations. Items from four forms and four administrations of the GRE Aptitude Test were…

The potential of item response theory (IRT) for solving a number of testing problems in the Maryland Functional Reading Program would appear to be substantial in view of the many other promising applications of the theory. But, it is well-known that the advantages derived from an IRT model cannot be achieved when the fit between an item response…

It is suggested that some of the technology applied to state Scholastic Aptitude Test scores to measure states' educational performance (particularly use of a truncated Gaussian model) may make it possible to adjust National Assessment of Educational Progress (NAEP) scores to make inferences about state educational progress possible. (SLD)

In 1972, the Oregon State Department of Education changed its standards relating to graduation requirements after a survey revealed concern that the high school diploma had lost its credibility. Parkrose School District developed a goal-based curriculum and measurement program to meet the new requirements. From the program's inception, District…

Two attempts to adjust state mean Scholastic Aptitude Test (SAT) scores for differential participation rates are examined. Both attempts are rejected, and five rules for performing adjustments are outlined to foster follow-up checks on untested assumptions. National Assessment of Educational Progress state data are determined to be more accurate.…

This paper discusses new psychometric analyses that improve capabilities for relating performance on achievement test items to instruction received by examinees. The modeling discussion is closely tied to data for eighth graders in the United States provided by the Second International Mathematics Study (SIMS), comprising not only responses to a…

A procedure is described for estimating the reliability and conditional standard errors of measurement of scale scores incorporating the discrete transformation of raw scores to scale scores. The method is illustrated using a strong true score model, and practical applications are described. (SLD)

This study investigated the feasibility of the use of the three-parameter item response theory (IRT) model in Florida's minimum competency testing program. The paper includes the following sections: (1) a description of the procedures currently being used by the assessment program, with an emphasis on procedures currently involving the Rasch…

This book shows the advantages of Rasch measurement (G. Rasch) for school district testing programs. The results of Rasch methods are contrasted with conventional statistics for assessing student responses to basic skills testing. Chapter 1 shows how the Rasch probability-based method produces measures that are more useful for students, parents,…