The stability was evaluated of a partial correlation index, comparisons of item characteristic curves, and comparisions of item difficulties in assessing race and sex differences in the performance of verbal items on the Graduate Record Examination Aptitude Test. All three indexes exhibited consistency in identifying the same items in different…

Addressing the shortcomings of classical item statistics for selecting criterion-referenced test items, this paper describes an optimal item selection procedure utilizing item response theory (IRT) and offers examples in which random selection and optimal item selection methods are compared. Theoretical advantages of optimal selection based upon…

The reported data provide a basis for evaluating the formula-scoring versus rights-scoring issue and for assessing the effects of directions on the reliability and parallelism of scores for sophisticated examinees taking professionally developed tests. Results support the invariance hypothesis rather than the differential effects hypothesis.…

PLANA is a training program for subject matter analysis and construction of instructional objectives. This evaluation compared the performance of PLANA-trained and control-group teachers as to their precision in defining teaching objectives and their corresponding instructional tasks and test items. (BW)

Describes "Bulletin Board" software program, which permits individuals or student groups to write, read, and/or evaluate student and instructor-generated multiple-choice and essay questions and to write and read news items. The program thus engages students more deeply in active learning, assessing course material, and providing peer…

This document is part of a series of materials meant to promote understanding of the knowledge and skills students must have and the kinds of work they must produce to be successful on the Graduation Exit Examination for the 21st Century (GEE 21). For GEE 21, student scores are reported at five achievement levels: advanced; mastery; basic;…

This study investigated the relationship between instructional use of handheld graphing calculators and student achievement in Algebra 1. Three end-of-course test forms were administered (without calculators) using matrix sampling to 458 high-school students in two suburban school districts in Oregon and Kansas. Test questions on two forms were…

Arizona's Instrument to Measure Standards High School (AIMS HS) is an assessment program that measures high school students' achievement of the Arizona Academic Standards adopted by the state Board of Education in three subject areas: reading, writing, and mathematics. All students in high school are required to participate in AIMS HS testing.…

This study examined the cross-lingual equating process adopted by a large scale testing system in which target language (TL) forms are equated to the source language (SL) forms using a set of translated items. The focus was on evaluating the degree of error inherent in the routine cross-lingual equating of the Verbal Reasoning subtest of the…

It has been found repeatedly that when test takers are allowed to choose a subset of constructed response (CR) items to answer on a test, they tend to choose differently and often perform lower on more popularly chosen items. This study investigated the psychological factors that influence test takers choices. Using an experience that incorporated…

Different item response theory (IRT) models may be employed for item calibration. Change of testing vendors, for example, may result in the adoption of a different model than that previously used with a testing program. To provide scale continuity and preserve cut score integrity, item parameter estimates from the new model must be linked to the…

A model for constrained computerized adaptive testing is proposed in which the information in the test at the ability estimate is maximized subject to a large variety of possible constraints on the contents of the test. At each item-selection step, a full test is first assembled to have maximum information at the current ability estimate fixing…

The comparison of item response theory models for the Test of English as a Foreign Language (TOEFL) was extended to an equating context as simulation trials were used to "equate the test to itself." Equating sample data were generated from administration of identical item sets. Equatings that used procedures based on each model (simple…

A simulation study of methods of assessing differential item functioning (DIF) in computer-adaptive tests (CATs) was conducted by Zwick, Thayer, and Wingersky (in press, 1993). Results showed that modified versions of the Mantel-Haenszel and standardization methods work well with CAT data. DIF methods were also investigated for nonadaptive…

In 1999, Rhode Island students in grades 3, 7, and 10 took a performance assessment in writing as part of the Rhode Island State Assessment Program. These two documents, a guide for educators and a guide for parents, describe the test and its scoring. The test is called a performance assessment because it requires the students to demonstrate their…