College instructors in the United States usually make their own decisions about how to design course exams. Even though summative course exams are well known to be important to student success, we know little about the decision making of instructors when designing course exams. To probe how instructors design exams for introductory biology, we…

A differential item functioning (DIF) simulation study was conducted to explore the type and level of impact that contamination had on type I error and power rates in DIF analyses when the suspect item favored the same or opposite group as the DIF items in the matching subtest. Type I error and power rates were displayed separately for the…

A computer adaptive test (CAT) is a delivery methodology that serves the larger goals of the assessment system in which it is embedded. A thorough analysis of the assessment system for which a CAT is being designed is critical to ensure that the delivery platform is appropriate and addresses all relevant complexities. As such, a CAT engine must be…

This report describes the purposes of benchmark assessments and provides recommendations for selecting and using benchmark assessments--addressing validity, alignment, reliability, fairness and bias and accessibility, instructional sensitivity, utility, and reporting issues. We also present recommendations on building capacity to support schools'…

A neglected element in designing tests is that of publicness, that is, the extent to which test specifications are understandable and usable by all interested parties. Issues related to content validity, such as test bias and instructional sensitivity, become accessible to these parties once content validity and design have been adequately…

Ten item discrimination indices, across a variety of item analysis situations, were compared, based on the validities of tests constructed by using each of the indices to select 40 items from a 100-item pool. Item score data were generated by a computer program and included a simulation of guessing. (Author/CTM)

A new test construction method based on integer linear programming is described. This method selects optimal tests in small amounts of computer time. The new method, called the Cluster-Based Method, assumes that the items in the bank have been grouped according to their item information curves so that items within a group, or cluster, are…

Two kinds of WISC-R short forms, item reduction and subtest reduction, are reviewed in terms of their ability to meet these criteria of adequacy: a significant correlation between the full scale IQ and the short form IQ, a non-significant difference between the full and short form mean IQ, a low percentage of IQ classification changes resulting…

Reasonable and practical solutions to two major problems confronting the developer of any test of educational achievement (what to measure and how to measure it) are proposed, defended, and defined. (Author/PN)

Two methods are proposed for the construction of weakly parallel tests based on a prespecified information function. A method is then described for selecting weakly parallel tests that are optimal with respect to the Maximin criterion. Numerical examples demonstrate the practicality of the tests. (SLD)

Item-test correlations are compared to item test-retest correlations as measures for selecting items in test construction. The author concludes that the item test-retest method is superior for item analysis which aims at getting shorter tests while maintaining test stability. (Author/JKS)

The uses, advantages and disadvantages, preparation, and scoring of essay tests and oral tests are outlined and discussed, and sample questions of each type oriented to pharmaceutical instruction are provided. (MSE)

The test item content of 17 language assessment tools that are widely used in a school or preschool setting are displayed in tabular form to assist speech-language pathologists. By noting the categories that are marked, the clinician can compare the breadth of the tests. (SEW)

As a preliminary step in customizing the Stanford Achievement Test, a study was made to compare the test items at each level with the curriculum objectives of a Florida school district, classifying them as either matching, above or below grade level, or unmatching. Results are shown in table form. (TE)

Analyses of student responses to Introductory Psychology test questions were discussed. The publisher supplied a two thousand item test bank on computer tape. Instructors selected questions for fifteen item tests. The test questions were labeled by the publisher as factual or conceptual. The semester course used a mastery learning format in which…