Research suggests screen reading is slower and possibly less accurate than reading from paper. Six study and test sessions over 10 months examined correct scores and retrieval responses for learning material presented via these two media. Correct scores did not differ suggesting that close matching of material can eliminate any decrement in…

Can computers help with one of the most persistent challenges of large classes: the accurate and efficient measurement of student learning?

Item response theory (IRT) has become one of the most popular scoring frameworks for measurement data. IRT models are used frequently in computerized adaptive testing, cognitively diagnostic assessment, and test equating. This article reviews two of the most popular software packages for IRT model estimation, BILOG-MG (Zimowski, Muraki, Mislevy, &…

This paper describes a new ICT assessment tool that reduces multihandling of marks, comments and scores specifically where professional judgement is involved. Whereas previous ICT applications in most fields of education have focused on student learning, this tool focuses on the lecturer task of the assessment process. Unlike many ICT based…

This study investigated the equivalence of scores from computerized and paper-and-pencil formats of a series of K-3 reading screening tests. Concerns about score equivalence on the computerized formats were warranted because of the use of reading passages, computer unfamiliarity of primary school students, and teacher versus computer…

Preventing items in adaptive testing from being over- or underexposed is one of the main problems in computerized adaptive testing. Though the problem of overexposed items can be solved using a probabilistic item-exposure control method, such methods are unable to deal with the problem of underexposed items. Using a system of rotating item pools,…

In computer-based interactive environments meant to support learning, students must bring a wide range of relevant knowledge, skills, and abilities to bear jointly as they solve meaningful problems in a learning domain. To function effectively as an assessment, a computer system must additionally be able to evoke and interpret observable evidence…

Computer-administered exams offer many advantages, but instructors may be reluctant to use them due to concerns that computer anxiety may increase student test anxiety. Introductory psychology students (N = 265) completed surveys prior to their first exam about their anxiety related to the upcoming exam, computers in general, and taking exams on…

In this article, we describe the development and trial of a bilingual computerized test of vocabulary size, the number of words the learner knows, and strength, a combination of four aspects of knowledge of meaning that are assumed to constitute a hierarchy of difficulty: passive recognition easiest, active recognition, passive recall, and active…

The authors examined the extent to which the Realistic, Investigative, Artistic, Social, Enterprising, and Conventional scales and 3-point codes of the Self-Directed Search may be considered statistically and practically equivalent across 3 different modes of administration: paper-and-pencil, personal computer, and Internet. Student preferences…

Three studies (N = 171) examined preschool children's tendency to use category information to make inferences about ambiguous behavior. Children heard stories in which category information about story characters was manipulated and behavioral information was held constant. Participants were asked to evaluate, explain, and determine the…

This paper reports some recent developments in mathematical computer-aided assessment which employs computer algebra to evaluate students' work using the Internet. Technical and educational issues raised by this use of computer algebra are addressed. Working examples from core calculus and algebra which have been used with first year university…

Cognitive load theory (CLT) has been successful in identifying instructional formats that are more effective and efficient than conventional problem solving in the initial, novice phase of skill acquisition. However, recent findings regarding the "expertise reversal effect" have begun to stimulate cognitive load theorists to broaden their horizon…

A new sharing item response theory (SIRT) model is presented that explicitly models the effects of sharing item content between informants and test takers. This model is used to construct adaptive item selection and scoring rules that provide increased precision and reduced score gains in instances where sharing occurs. The adaptive item selection…

The primary purpose of this research is to examine the impact of estimation methods, actual latent trait distributions, and item pool characteristics on the performance of a simulated computerized adaptive testing (CAT) system. In this study, three estimation procedures are compared for accuracy of estimation: maximum likelihood estimation (MLE),…