Testing programs have explored the use of technology-enhanced items alongside traditional item types (e.g., multiple-choice and constructed-response items) as measurement evidence of latent constructs modeled with item response theory (IRT). In this report, we discuss considerations in applying IRT models to a particular type of adaptive testlet…

This study focused on the effect of examinees' ability levels on the relationship between Reflective-Impulsive (RI) cognitive style and item response time in computerized adaptive testing (CAT). The total of 56 students majoring in Educational Technology from Shandong Normal University participated in this study, and their RI cognitive styles were…

Solving complicated problems in a contemporary knowledge-based society requires higher-order thinking (HOT). The most productive way to encourage development of HOT in students is through use of the Problem-based Learning (PBL) model. This model organizes learning by solving corresponding problems relative to study courses. Students are directed…

The aim of the present study was to develop an on-line assessment system with constructed response items in the context of elementary mathematics curriculum. The system recorded the problem solving process of constructed response items and transfered the process to response codes for further analyses. An inference mechanism based on artificial…

Computer-based testing (CBT) to assess second language ability has undergone remarkable development since Garret (1991) described its purpose as "the computerized administration of conventional tests" in "The Modern Language Journal." For instance, CBT has made possible the delivery of more authentic tests than traditional paper-and-pencil tests.…

Describes three open-ended response types that could broaden the conception of mathematical problem solving used in computerized admissions tests: (1) mathematical expression (ME); (2) generating examples (GE); and (3) and graphical modeling (GM). Illustrates how combining ME, GE, and GM can form extended constructed response problems. (SLD)

Preventing items in adaptive testing from being over- or underexposed is one of the main problems in computerized adaptive testing. Though the problem of overexposed items can be solved using a probabilistic item-exposure control method, such methods are unable to deal with the problem of underexposed items. Using a system of rotating item pools,…

Recent research studies have reported on how novices and experts differ in storing, organizing, and retrieving subject matter knowledge and on how they apply their knowledge to solve new problems. These findings have been integrated and implemented in a computer environment to help novices improve their problem-solving skills. An outline of this…

Discusses the unique advantages provided by computer-based (CB) testing. Describes the various forms of CB tests used in higher education and the variety of testing applications of computers in colleges and universities. Presents psychometric issues and concerns related to CB testing along with relevant research findings. (Author/PVV)

Implementation of an adaptive achievement test for teaching signed-numbers operations to junior high students is described. A computer program capable of finding 240 basic errors in signed-number computations was written on the PLATO system and used for analyzing a 64-item conventional test, as well as an adaptive test of addition problems. The…

A small-scale study was conducted to compare test-taking strategies, problem-solving strategies, and general impressions about the test across computer and paper-and-pencil administration modes. Thirty-six examinees (high school students) participated in the study. Each examinee took a test in one of the content areas of English, Mathematics,…

This final report describes the outcomes of Project MAPS (Monitoring Authentic Problem Solving), a project that developed multimedia computer-managed assessment environments to overcome the barriers educators face in using problem-solving performance assessment (PSPA) with students with disabilities. MAPS software was developed for 6 alternate…

Describes a pilot study of computerized adaptive testing in the Michigan Educational Assessment Program's tenth-grade mathematics problem-solving and applications subtests. Comparisons are made to pencil-and-paper tests, and student reactions as determined by a posttest survey are discussed. (LRW)

A pilot study on the development and administration of a test using a spatial reasoning problem, the 15-puzzle, is described. The test utilizes on-line capabilities of a real-time computer to record an examinee's progress on each problem through a sequence of problem-solving "moves", and to collect additional on-line data that might be…