Best linear prediction (BLP) and penalized best linear prediction (PBLP) are techniques for combining sources of information to produce task scores, section scores, and composite test scores. The report examines issues to consider in operational implementation of BLP and PBLP in testing programs administered by ETS [Educational Testing Service].

A statistical model is proposed that describes the determination of an educational outcome variable as a nonlinear function of explanatory variables defined at different levels of a survey data hierarchy, such as students and classes. The theoretical and practical derivation of the model is discussed, and an example is given. (Author/BW)

To evaluate test speededness and to derive implications for test program activity, this study reviewed the literature on speed and power, identifying four major approaches to the assessment of speed: the Gulliksen approach, the Cronbach and Warrington approach, the Stafford approach, and the approach of the Educational Testing Service (ETS) as…

This paper outlines a methodology that school districts can use to enhance the presentation of district-wide testing program results to administrators, school boards, teachers, and the public. Based on John Tukey's two way analysis methodology, it involves fitting this model: test score equals overall plus year plus grade plus cohort plus…

The feasibility of using item response theory (IRT) as a psychometric model for the Graduate Record Examination (GRE) Aptitude Test was addressed by assessing the reasonableness of the assumptions of item response theory for GRE item types and examinee populations. Items from four forms and four administrations of the GRE Aptitude Test were…

The potential of item response theory (IRT) for solving a number of testing problems in the Maryland Functional Reading Program would appear to be substantial in view of the many other promising applications of the theory. But, it is well-known that the advantages derived from an IRT model cannot be achieved when the fit between an item response…

Two attempts to adjust state mean Scholastic Aptitude Test (SAT) scores for differential participation rates are examined. Both attempts are rejected, and five rules for performing adjustments are outlined to foster follow-up checks on untested assumptions. National Assessment of Educational Progress state data are determined to be more accurate.…

This paper discusses new psychometric analyses that improve capabilities for relating performance on achievement test items to instruction received by examinees. The modeling discussion is closely tied to data for eighth graders in the United States provided by the Second International Mathematics Study (SIMS), comprising not only responses to a…

The 1990 National Assessment of Educational Progress (NAEP) will mark the first time that state-level comparisons will be possible with NAEP data. The 1990 data will contain, as a trial component, state-level assessments of eighth graders in mathematics. Mathematics and reading comparisons for fourth graders will be added in 1992. Statistical…

The results of a study which used the regression discontinuity model in the analysis of criterion-referenced test data are presented and inherent drawbacks in the use of the regression discontinuity model with this type of data are discussed. The discussion is based on the results of an analysis of data collected in the Mesa, Arizona School…

Limitations of using linear, unilevel regression procedures in modeling student achievement are discussed. This study is a part of a broader study that is developing an empirically-based predictive model of variables associated with academic achievement from a multilevel perspective and examining the differences by which parameters are estimated…

Latent trait model calibration procedures were used on data obtained from a group testing program. The one-parameter model of Wright and Panchapakesan and the three-parameter logistic model of Wingersky, Wood, and Lord were selected for comparison. These models and their corresponding estimation procedures were compared, using actual and simulated…

Results from the Maryland School Performance Assessment Program for 5,392 elementary school students and from the Comprehensive Tests of Basic Skills (multiple choice) for a national sample are used to explore local item independence (LID) of test items. Some strategies are suggested for measuring LID in performance assessments. (SLD)

The purpose of this research was to develop and test a method of identifying groups of students participating in a mandated statewide norm-referenced testing program who have undergone highly specific training in preparation for, or coaching during, test administration. The implementation of the analysis procedure was intended not only to identify…

The impact of test item multidimensionality was examined as it affected fitting items on a teacher licensure test to an item response theory (IRT) model. Test item data from the 1990 study of G. W. Guiton and G. Delandshere are used. The Connecticut Elementary Certification Test (CONNECT) is a licensure examination designed to assess the subject…