The State of New York Agriculture Science Education secondary program is required to have a certification exam for students to assess their agriculture science education experience as a Regent's requirement towards graduation. This paper focuses on the procedure used to develop and validate two content sub-test questions within a…

A strict equivalence presupposed by Kaiser and Michael to derive the coefficient of "domain validity" is defensible only as a biased approximation. But then, it is far from clear what psychometric significance this coefficient has in the first place. (Author)

Various item selection techniques are compared on criterion-referenced reliability and validity. Techniques compared include three nominal criterion-referenced methods, a traditional point biserial selection, teacher selection, and random selection. (Author)

Attention is drawn to the dynamics of criterion-referenced test (CRT) construction in this report. How CRT's are developed at the Instructional Objectives Exchange is described through a series of three steps. The procedures pertain to the construction of "off the shelf" as well as "customized" tests. Step one, isolating the…

A unique system is described for creating tests by computer. It is unique because, instead of storing items in the computer, item algorithms similar to Hively's notion of item forms are banked. Every item, and thus every test, represents a sample from domains consisting of thousands of items. The paper contains a discussion of the special…

An attempt to outline the simplest framework for achievement testing that shows the relationship between achievement tests and the instructional programs, and to show how achievement testing may be implemented within this framework. (Author/DEP)

Identifies a number of practical decisions that must be made when designing and developing criterion referenced tests as part of a larger system of computer assisted instruction. The topics discussed include test construction, test security, item presentation, and response capturing and scoring. (19 references) (CLB)

For almost 20 years, the Portland public schools have maintained a testing program anchored in locally constructed tests. The district's newly developed tests are called goal-referenced tests, a version of criterion-referenced tests, that meet the district's purposes because they reflect what well-qualified teachers in the district believe should…

Reviews materials from Multiscore, a criterion-referenced testing service which produces tests tailored to particular schools or districts from its item bank of more than 20,000 multiple-choice items. Discusses technical considerations, use of Multiscore in local school districts, and evaluation and conclusions. (SR)

A new method was developed to assist in the selection of a test length by utilizing computer simulation procedures and item response theory. A demonstration of the method presents results which address the influences of item pool heterogeneity matched to the objectives of interest and the method of item selection. (Author/PN)

The 104 instruments in this bibliography contain collections of test items or learning objectives with accompanying sample items for use in the construction of tests. In some cases, actual test construction is performed by the publisher. Subjects covered include: reading, mathematics, sciences, languages, social sciences, and the arts. Some item…

The present study showed that Rasch-based adaptive tests--when item domains were finite and specifiable--had greater precision in domain score estimation than test forms created by random sampling of items. Results were replicated across four data sources representing a variety of criterion-referenced, domain-based tests varying in length.…

Describes procedure for combining Stanford Achievement Test items with local supplementary items to measure individual and aggregate student performance in mathematics. Two reports are generated from the test results: a diagnostic report of student mastery of each objective and an overall score. (TE)

Described is a joint project of 23 Illinois school districts to develop criterion-referenced test item pools in mathematics and language arts to meet the day-to-day testing needs of classroom teachers and to aid in the development of minimum competency tests mandated by Illinois Senate Bill 238. (Author/SJL)

Formulas are presented for decision reliability and for classification validity for mastery/nonmastery decisions based on criterion referenced tests. Two item parameters are used: the probability of a master answering an item correctly, and the probability of a nonmaster answering an item incorrectly. The theory explores the relationships of…