False positive and false negative error rates were studied for competency testing when failing examinees are permitted to retake the test. Formulas are provided for the beta-binomial and Rasch models. Estimates based on these models are compared for six data sets from the South Carolina Basic Skills Assessment Program. (SLD)

The potential of item response theory (IRT) for solving a number of testing problems in the Maryland Functional Reading Program would appear to be substantial in view of the many other promising applications of the theory. But, it is well-known that the advantages derived from an IRT model cannot be achieved when the fit between an item response…

It is suggested that some of the technology applied to state Scholastic Aptitude Test scores to measure states' educational performance (particularly use of a truncated Gaussian model) may make it possible to adjust National Assessment of Educational Progress (NAEP) scores to make inferences about state educational progress possible. (SLD)

Two attempts to adjust state mean Scholastic Aptitude Test (SAT) scores for differential participation rates are examined. Both attempts are rejected, and five rules for performing adjustments are outlined to foster follow-up checks on untested assumptions. National Assessment of Educational Progress state data are determined to be more accurate.…

This study investigated the feasibility of the use of the three-parameter item response theory (IRT) model in Florida's minimum competency testing program. The paper includes the following sections: (1) a description of the procedures currently being used by the assessment program, with an emphasis on procedures currently involving the Rasch…

The 1990 National Assessment of Educational Progress (NAEP) will mark the first time that state-level comparisons will be possible with NAEP data. The 1990 data will contain, as a trial component, state-level assessments of eighth graders in mathematics. Mathematics and reading comparisons for fourth graders will be added in 1992. Statistical…

This study investigated the feasibility of using the three-parameter model in Florida's minimum competency testing program. LOGIST 4 was used to analyze 1984 Statewide Student Assessment Tests (SSAT)-II data, exploring possibilities that easiness of the test would cause problems in the estimation of the a and c parameters. These problems and…

Limitations of using linear, unilevel regression procedures in modeling student achievement are discussed. This study is a part of a broader study that is developing an empirically-based predictive model of variables associated with academic achievement from a multilevel perspective and examining the differences by which parameters are estimated…

Results from the Maryland School Performance Assessment Program for 5,392 elementary school students and from the Comprehensive Tests of Basic Skills (multiple choice) for a national sample are used to explore local item independence (LID) of test items. Some strategies are suggested for measuring LID in performance assessments. (SLD)

The purpose of this research was to develop and test a method of identifying groups of students participating in a mandated statewide norm-referenced testing program who have undergone highly specific training in preparation for, or coaching during, test administration. The implementation of the analysis procedure was intended not only to identify…

The impact of test item multidimensionality was examined as it affected fitting items on a teacher licensure test to an item response theory (IRT) model. Test item data from the 1990 study of G. W. Guiton and G. Delandshere are used. The Connecticut Elementary Certification Test (CONNECT) is a licensure examination designed to assess the subject…

State testing programs often attempt to provide annual information for use in student guidance and qualification, school and program evaluation, and broad policy decisions. With the development of a new type of assessment instrument, the "duplex design," the several functions of state testing programs can be served in a single test…

A procedure which employs a method of item substitution based on item difficulty is recommended for developing parallel criterion referenced test forms. This procedure is currently being used in the Florida functional literacy testing program and the Georgia teacher certification testing program. Reasons for developing parallel test forms involve…

Four problems faced by the staff of the California Assessment Program (CAP) were solved by applying Rasch scaling techniques: (1) item cultural bias in the Entry Level Test (ELT) given to all first grade pupils; (2) nonlinear regression analysis of the third grade Reading Test scores; (3) comparison of school growth from grades two to three, using…