Effective assessment of laboratory practicals is a challenge for large-size classes. To reduce the administrative burden of staff members without compromising the student learning experience, we utilized dedicated computer software for short-answer question assessment for nearly 300 students and compared it with the more traditional, paper-based…

With federal funding riding on test scores, student performance is crucial. Information systems are an important ingredient of assessments that are sometimes overlooked. Small rural school districts, such as Orange County, Virginia, often have only a modest IT budget and must find ways to improve the reliability and redundancy of their systems.…

Differential item functioning (DIF) assessment attempts to identify items or item types for which subpopulations of examinees exhibit performance differentials that are not consistent with the performance differentials typically seen for those subpopulations on collections of items that purport to measure a common construct. DIF assessment…

Dichotomous item response theory (IRT) models can be viewed as families of stochastically ordered distributions of responses to test items. This paper explores several properties of such distributions. The focus is on the conditions under which stochastic order in families of conditional distributions is transferred to their inverse distributions,…

This paper investigates the performance of CATSIB (a modified version of the SIBTEST computer program) to assess differential item functioning (DIF) in the context of computerized adaptive testing (CAT). One of the distinguishing features of CATSIB is its theoretically built-in regression correction to control for the Type I error rates when the…

This paper reports a method for assessing the adequacy of existing item banks for computer adaptive testing. The method takes into account content specifications, test length, and stopping rules, and can be used to determine if an existing item bank is adequate to administer a computer adaptive test efficiently across differing levels of examinee…

This study assessed whether redundant stimuli are beneficial in motor performance, and how redundant information is processed, using 11 male and 11 female undergraduate students. A minimum information tracking task was presented to subjects on a computer in seven conditions. Overall, evidence seems to point to enhanced performance when information…

It is unrealistic to suppose that standard item response theory (IRT) models will be appropriate for all new and currently considered computer-based tests. In addition to developing new models, researchers will need to give some attention to the possibility of constructing and analyzing new tests without the aid of strong models. Computerized…

An experiment involving 20 graduate and undergraduate students (7 males and 13 females) at West Virginia University (Morgantown) assessed "fan network structures" of recognition memory. A fan in network memory structure occurs when several facts are connected into a single node (concept). The more links from that concept to various…

Online student assessment features in many distance-learning programs. The prevention of plagiarism has been the subject of much attention, but insufficient attention has been given to other problems of dishonesty in online assessment. We survey the types of problems that can occur and what can be done about them. We believe many educators are…

This paper focuses on computer-based assessment embedded in the process of instruction, with the assessment being used for placement, assignment, instructional feedback, progress assessment, and/or exit testing. This discussion is based on experience in developing and evaluating assessment and instruction materials for college-level remedial…

Research has shown that multiple-choice questions formed by transforming or paraphrasing a reading passage provide a measure of student comprehension. It is argued that similar transformation and paraphrasing of lesson questions is an appropriate way to form parallel multiple-choice items to be used as a posttest measure of student comprehension.…

This paper reviews the research literature regarding the importance of Witkin's theory of psychological differentiation, particularly the research on measures of field independence using perceptual disembedding tasks. The first phase of development of a multiple-choice perceptual disembedding measure, the Finding Embedded Figures Test, is…

A study of 696 undergraduates at the University of Northern Colorado was undertaken to determine the effects of computerized unit test item feedback on final examination scores. The study, which employed the PHOENIX computer managed instruction system, included students at all undergraduate levels enrolled in an Oceanography course. To determine…

In January 1985, Employment and Immigration Canada funded a pilot project in New Brunswick for the development and testing of an Interprovincial Computerized Examination Management (ICEM) System. The resulting system is comprised of a dual interprovincial and provincial item bank facility, a software component offering the option of computerized…