The National Board of Medical Examiners uses the Rasch model to calibrate test items, maintain item banks, equate scores, and monitor the consistency of examiner item response patterns. The model is also being used in the study of patient management problems examinations, standard-setting, and computer-based examinations. (Author/BS)

The purpose of this paper is to identify and discuss some of the problems presented by the use of computerized adaptive testing (CAT) in an instructional programs environment versus large scale testing applications, and to describe an actual implementation of CAT in an instructional programs setting. This particular application is in the…

This report describes the sequence of activities that took place as the Examination Division of the New Jersey Department of Civil Service introduced a word processing system for a test item bank and for production of camera-ready test copy. The equipment selection, installation and orientation procedures are discussed. Keyboard and CRT terminals,…

Describes procedure for combining Stanford Achievement Test items with local supplementary items to measure individual and aggregate student performance in mathematics. Two reports are generated from the test results: a diagnostic report of student mastery of each objective and an overall score. (TE)

An ideal system of the National Assessment of Educational Progress (NAEP), from the local school district perspective, must follow several principles based on the 1985 Standards for Educational and Psychological Testing: (1) Testing must be viewed by teachers and students as worthwhile. (2) Test results must be presented in a timely and useful…

This paper presents an explanation of the program design of the three separate Pascal-language programs which comprise UCLA's Diagnostic Testing Package "DX." The three parts of the DX test package are three closely interrelated programs--Editest, Runtest, and Summary. Editest serves the following functions: (1) the creation of a…

The use of item banks and item response theory has resulted in new ways to misinterpret and misuse tests through customized, yet standardized, achievement test batteries. The new test batteries create the possibility of serious misunderstandings based on the idea that any subset of items from the pool with a proper range of difficulties will…

Criticisms of norm referenced standardized tests are contrasted with the assumption and claims of proponents of Rasch model testing and item banking. The Rasch test theory model is based on the assumption of equal interval curriculum referenced scales for both students' abilities and test item difficulties. The Portland school district has…

Test-item writing efforts typically results in item pools with an undesirable correlational structure between the content attributes of the items and their statistical information. If such pools are used in computerized adaptive testing (CAT), the algorithm may be forced to select items with less than optimal information, that violate the content…

As a result of using the Rasch model in building item banks in reading and mathematics, we were able to design two new testing programs for our district. The first was a grade level competency-based evaluation program designed to identify our district's low achievement-level students as well as the precompetency goals on which they needed help.…

This study investigated the feasibility of the use of the three-parameter item response theory (IRT) model in Florida's minimum competency testing program. The paper includes the following sections: (1) a description of the procedures currently being used by the assessment program, with an emphasis on procedures currently involving the Rasch…

Data gathered from large-scale assessments in the Ontario Assessment Instrument Pool (OAIP) are examined. Implications for science instruction are to be found at the item level; the items should not involve more than two or three steps if the responses are to be informative. Items are collected and linked to provincial curriculum guidelines. These…

The Mathematics Achievement Test Project (MATP) was set up by the Learning Assessment Branch of the Ministry of Education of British Columbia to develop testing materials to assist teachers throughout the province in the task of evaluating students' performance in mathematics. The two major objectives of the project were to construct "banks" of…

This book shows the advantages of Rasch measurement (G. Rasch) for school district testing programs. The results of Rasch methods are contrasted with conventional statistics for assessing student responses to basic skills testing. Chapter 1 shows how the Rasch probability-based method produces measures that are more useful for students, parents,…

The Learning Outcome Testing Program of the West Virginia Department of Education is designed to provide public school teachers/administrators with test questions matching learning outcomes. The approach, software selection, results of pilot tests with teachers in 13 sites, and development of test items for item banks are described. (SLD)