Operational testing programs employing item response theory (IRT) applications benefit from of the property of item parameter invariance whereby item parameter estimates obtained from one sample can be applied to other samples (when the underlying assumptions are satisfied). In theory, this feature allows for applications such as computer-adaptive…

This paper discusses the validity of test preparation practices in the context of large-scale norm-referenced and criterion-referenced tests. It presents a framework for conceptualizing the various aspects of test preparation that includes the basic premises underlying the validity of the practices. Five areas of test preparation are outlined: (1)…

Person fit in the Rasch one parameter model is investigated. The first set of data deals with grade 3 students responding to the mathematics computation and reading vocabulary subscales of the Comprehensive Test of Basic Skills Forms (CTBS/S). The second set of data deals with grade 3 students responding to the Basic Skills Assessment Program…

A statewide sustained effort to improve student learning in Missouri by adopting and adapting promising research-based educational practices is described. The concept of an Instructional Management System (IMS) with desired learner outcomes determining both instruction and testing was suggested to local school districts beginning in 1980. In 1985,…

A new standard setting method, Mapmark, was recently developed by ACT Inc. in the course of a contract with the National Assessment Governing Board (NAGB) to set achievement levels for the 2005 National Assessment of Educational Progress (NAEP) in Grade 12 mathematics. Mapmark includes elements of the bookmark method (Lewis, Mitzel, & Green, 1996;…