The development of innovative test item types that use multimedia technology to improve item authenticity and interaction and allow for objective scoring through partial-credit scoring methodologies was studied. Science test items were developed for community college developmental students using "Authorware 3.0," an instructional compact disc. The…

Two computer-based categorization tasks were developed and pilot tested. In study 1, the task asked examinees to sort mathematical word problem stems according to prototypes. Results with 9 faculty members and 107 undergraduates showed that those who sorted well tended to have higher Graduate Record Examination General Test scores and college…

This study examined performance of a simulated computerized adaptive test that was designed to help direct the development of a medical recertification examination. The item pool consisted of 229 single-best-answer items from a random sample of 3,000 examinees, calibrated using the two-parameter logistic model. Examinees' responses were known. For…

A predictive adaptive testing (PAT) strategy was developed based on statistical predictive analysis, and its feasibility was studied by comparing PAT performance to those of the Flexilevel, Bayesian modal, and expected a posteriori (EAP) strategies in a simulated environment. The proposed adaptive test is based on the idea of using item difficulty…

Dichotomous search strategies (DSSs) for computerized adaptive testing are similar to golden section search strategies (GSSSs). Each middle point of successive search regions is a testing point. After each item is administered, the subject's obtained score is compared with the expected score at successive testing points. If the subject's obtained…

Before an item bank is constructed, several curriculum and testing considerations should be addressed. Such issues include the number of students enrolled in the selected subject area; number of desired objectives and items per objective; method of storing the items; and how and when to train how many teachers in item writing. The following steps…

An overview of the development of a computerized version of the Differential Aptitude Tests (DAT) is presented. It describes the previously existing printed version of the DAT, design of the computerized adaptive edition, calibration of the test items for use in the computerized version, and two field studies that compared the Adaptive and…

The following steps have been taken to accomplish the goals of the Wisconsin Pupil Assessment Program: the development of objective-referenced tests; the administration of a standardized norm-referenced test; reporting of trends in performance on these tests; and the availability of two testing services and personnel for consultation purposes.…

In addition to the usual drawbacks of large enrollment college classes such as impersonal atmosphere, discouragement of questions, and insensitivity to individual differences, the testing methods that tend to be associated with large classes can be detrimental to the learning process. Objective tests decrease the level of intellectual mastery…

In 1996, the Department of Computer Science at Monash University (Australia) implemented a First Year Advanced Students' Project Scheme aimed at extending and stimulating its best first year students. The goal of the scheme was to give students the opportunity to work on a project that best suited their needs and captured their interests. One of…

To assess students' business writing abilities upon entry into the business program and exit from the capstone course, a multitiered assessment package was developed that measures students' achievement of specific learning outcomes and provides "value-added" scores. The online segment of the test measures five competencies across three process…

This book offers specific how-to advice to college faculty on every stage of the testing process, including planning the test and classifying objectives to be measured, ensuring the validity and reliability of the test, and grading in such a way as to arrive at fair grades based on relevant data. The book examines the strengths and weaknesses of…

A method of qualitative data analysis that used computer software as a tool to help organize and analyze open-ended survey responses was examined. Reasons for using open-ended, as opposed to closed-ended questionnaire items, are discussed, as well as the construction of open-ended questions and response analysis. Because the method is based on…

This book provides basic skills and knowledge about assessment so that teachers can expand their ability to deal with appraisal problems in their own settings. The first section deals with the basic principles of assessment. The second section concerns creating and applying assessment tools. The third section reviews issues in understanding and…

The development and preliminary evaluation of the Computerized Adaptive Testing System (CATSYS), a new testing package for IBM-compatible microcomputers, are described. CATSYS can be used to administer and score operational adaptive tests or to conduct on-line computer simulation studies. The package incorporates several innovative features,…