Operational testing programs employing item response theory (IRT) applications benefit from of the property of item parameter invariance whereby item parameter estimates obtained from one sample can be applied to other samples (when the underlying assumptions are satisfied). In theory, this feature allows for applications such as computer-adaptive…

Rescoring of Center for Occupational and Professional Assessment objective-referenced tests is decided largely by content experts selected by client organizations. A few of the test items, statistically flagged for review, are not rescored. Some of this incongruence could be due to the use of the biserial correlation (r-biserial) as an…

This paper was presented with other papers in a forum dealing with statewide testing programs. The primary purpose of the paper is to address practical considerations and methods of resolution for large districts or states who are planning on conducting large scale testing or assessment programs with criterion or performance referenced measures.…

The Maryland State Department of Education issued a request for proposals to develop a score reporting system for the Maryland Functional Testing Program. RMC Research Corporation conducted a literature review of extant literature and developed a national survey of non-norm-referenced test score reporting practices. This comprehensive analysis of…

Although most states use a single strategy for statewide assessment, one Midwestern state has chosen a model in which local school districts are responsible for developing strategies to measure and report students' progress on state-adopted content strategies. This paper describes the state assessment system and focuses on the perspectives of…

In 1972, the Oregon State Department of Education changed its standards relating to graduation requirements after a survey revealed concern that the high school diploma had lost its credibility. Parkrose School District developed a goal-based curriculum and measurement program to meet the new requirements. From the program's inception, District…

This paper describes the methods used for revising the Cincinnati Mathematics Inventories, a battery of criterion-referenced tests of basic skills used in the Cincinnati Title III program and other city-wide special programs. Each of these tests is designed to cover a half-year of work; items are included to sample skills listed in the Catalog of…

This speech presents instructional evaluation techniques currently used in Belleville, Illinois. These are based on two criteria: (1) community opinion, and (2) performance level of students. To discover community opinions, needs, priorities, and levels of support, questionnaires are distributed, presenting a series of curricular goals and…

Kansas law requires setting passing scores for the reading and mathematics competency test for 2nd, 4th, 6th, 8th, and 11th grade students, administered annually since April of 1980. New objective-referenced tests are prepared each year. Both judgmental (Angoff, Ebel, and Nedelsky) methods and empirical (contrasting groups and borderline) methods…

One Midwestern state has chosen a model of state assessment in which local school districts are responsible for developing the strategies to measure and report their students' performance on state-adopted content standards. When students are not measured on common instruments, district accountability becomes an added challenge. This paper presents…

A statewide sustained effort to improve student learning in Missouri by adopting and adapting promising research-based educational practices is described. The concept of an Instructional Management System (IMS) with desired learner outcomes determining both instruction and testing was suggested to local school districts beginning in 1980. In 1985,…

In 1984 an evaluation team examined the Maryland Functional Testing Program (MFTP), a statewide competency-based, criterion-referenced testing program that was instituted to limit awarding of high school diplomas to those students who had earned scores above cut scores on a series of achievement tests. This article examines the procedures the…

The comprehensive system of external examinations in Scotland has undergone major changes. The external examination system has been expanded to cover the entire secondary school curriculum. The examinations will now be administered to all students. The "continuum" model of criterion referenced tests has been adopted for the school…

This paper presents an evaluation of Army job training development and testing practices, with a focus on Advanced Individual Testing. Information comes from intensive interviews with school instructors and from observations in the schools. Results indicate that some aspects of the Instructional Systems Development (ISD) model have been…

The potential use of criterion referenced tests (CRT) and norm referenced tests (NRT) in the same testing program is discussed. The advantages and disadvantages of each are listed, and the best solution, a merging, is proposed. To merge CRTs and NRTs into an overall testing program, meaningful and useful to all levels, consideration must be given…