Based on John Rawls' theory of justice as fairness, a nine-item rating scale was developed to serve as a criterion in studies of test item bias. Two principles underlie the scale: (1) Within a defined usage, test items should not affect students so that they are unable to do as well as their abilities would indicate; and (2) within the domain of a…

Contains two articles relating to chemistry examination questions. One provides examples of how to sequence multiple choice questions so that partial credit may be given for some responses. The second includes a question and solution dealing with stereoisomerism as a result of free radical chlorination of a nonstereoisometic substance. (TW)

Describes statistical analyses of tests used for organic chemistry classes and attempts to pose a model to explain the results. Concluded that students who possess a slight grasp of a concept actually have less of a chance of answering an item correctly than those who merely guess. (CW)

Argues that tests should be used to improve instructional programs. Specific suggestions include the study of reports on test performance, item analysis on classroom tests, item analysis as a part of standardized test reports, use of diagnostic or inventory tests, and careful selection of test items. (PK)

Based on the standard setting procedures or the American Board of Preventive Medicine for their Core Test, this article describes how Rasch measurement can facilitate using test content judgments in setting a standard. Rasch measurement can then be used to evaluate and improve the precision of the standard and to hold it constant across time.…

Reviews seven commercially produced test generator programs appropriate for use by classroom teachers or individual instructors and identifies item construction and test formatting features that facilitate test design and delivery. Test generator programs and their manufacturers are listed. (MBR)

To identify broad classes of items on the Scholastic Aptitude Test that behave differentally for handicapped examinees taking special, extended time administrations, the performance of nine handicapped groups and one nonhandicapped group on each of two forms of the SAT was investigated through a two-stage procedure. (Author/LMO)

Three rating scales--with all positive or all negative wording, or a mixture of both--were administered to 522 children in grades four through six. The results indicated that it was difficult for students to indicate agreement by disagreeing with a negative statement. This affected test validity. Author/GDC)

Determined which of 10 rational thinking powers are measured by 12 commercially-available standardized science tests. One result reported is that 90 percent of the test items required only recall. The conclusion was drawn that the producers of standardized tests are not concerned with measuring student achievement of the rational powers.…

This study of individual differences in performance of a geometric analogies task included four-alternative test items and studied eye movements and confidence judgments as well as latency and error. Results were interpreted using two hypothesized performance strategies: constructive matching and response elimination. (Author/BW)

Students were asked to rate several hypothetical instructor profiles, constructed by systematically manipulating information about the instructors' classroom behaviors. Factor analyses were performed where factors represented clusters of semantically equivalent items. Students imposed an implicit semantic organization on their ratings, apart from…

The purpose of this writing sampler is to provide teachers and students with work representing each of the rubric score points for the stand alone writing prompt on the 2001 Delaware Student Testing Program. The student papers included in this document are part of the "anchor sets" (collections of scored student work "anchored"…

With the increased use of computerized adaptive testing, which allows for continuous testing, new concerns about test security have evolved, one being the assurance that items in an item pool are safeguarded from theft. In this paper, the risk of score inflation and procedures to detect test takers using item preknowledge are explored. When test…

Writing assessment began in Alaska in the 1970s, and the Alaska Writing Assessment (AWA) that was piloted in 1997 built on previous efforts. The 1997 AWA involved more than 20,000 students in grades 5, 7, and 10 from 43 school districts, and the mandatory assessment planned for 1998 will include approximately 28,000 students. This review of the…

The operating characteristics of 114 mathematics pretest items from the Praxis I: Computer Based Test were analyzed in terms of item attributes and test developers' judgments of item difficulty. Item operating characteristics were defined as the difficulty, discrimination, and asymptote parameters of a three parameter logistic item response theory…