Most educators today would agree that the mission of the teaching profession has become more complex and much more challenging than ever before. Changes in district demographics, societal pressures that require more personalized student attention, evermore stringent governmental demands, and constant budgetary concerns all have an impact on…

Research suggests screen reading is slower and possibly less accurate than reading from paper. Six study and test sessions over 10 months examined correct scores and retrieval responses for learning material presented via these two media. Correct scores did not differ suggesting that close matching of material can eliminate any decrement in…

Can computers help with one of the most persistent challenges of large classes: the accurate and efficient measurement of student learning?

Item response theory (IRT) has become one of the most popular scoring frameworks for measurement data. IRT models are used frequently in computerized adaptive testing, cognitively diagnostic assessment, and test equating. This article reviews two of the most popular software packages for IRT model estimation, BILOG-MG (Zimowski, Muraki, Mislevy, &…

This paper describes a new ICT assessment tool that reduces multihandling of marks, comments and scores specifically where professional judgement is involved. Whereas previous ICT applications in most fields of education have focused on student learning, this tool focuses on the lecturer task of the assessment process. Unlike many ICT based…

This study investigated the equivalence of scores from computerized and paper-and-pencil formats of a series of K-3 reading screening tests. Concerns about score equivalence on the computerized formats were warranted because of the use of reading passages, computer unfamiliarity of primary school students, and teacher versus computer…

Adaptive tests offer the advantages of reduced test length and increased accuracy in ability estimation. However, adaptive tests require large pools of precalibrated items. This study looks at the development of an item pool for 1 type of adaptive administration: the computer-adaptive sequential test. An important issue is the sample size required…

Preventing items in adaptive testing from being over- or underexposed is one of the main problems in computerized adaptive testing. Though the problem of overexposed items can be solved using a probabilistic item-exposure control method, such methods are unable to deal with the problem of underexposed items. Using a system of rotating item pools,…

Computerized adaptive tests (CATs) are individualized tests that, from a measurement point of view, are optimal for each individual, possibly under some practical conditions. In the present study, it is shown that maximum information item selection in CATs using an item bank that is calibrated with the one- or the two-parameter logistic model…

The effects of five ability estimators, that is, maximum likelihood estimator, weighted likelihood estimator, maximum a posteriori, expected a posteriori, and Owen's sequential estimator, on the performances of the item response theory-based adaptive classification procedure on multiple categories were studied via simulations. The following…

In computer-based interactive environments meant to support learning, students must bring a wide range of relevant knowledge, skills, and abilities to bear jointly as they solve meaningful problems in a learning domain. To function effectively as an assessment, a computer system must additionally be able to evoke and interpret observable evidence…

Computer-administered exams offer many advantages, but instructors may be reluctant to use them due to concerns that computer anxiety may increase student test anxiety. Introductory psychology students (N = 265) completed surveys prior to their first exam about their anxiety related to the upcoming exam, computers in general, and taking exams on…

In this article, we describe the development and trial of a bilingual computerized test of vocabulary size, the number of words the learner knows, and strength, a combination of four aspects of knowledge of meaning that are assumed to constitute a hierarchy of difficulty: passive recognition easiest, active recognition, passive recall, and active…

The authors examined the extent to which the Realistic, Investigative, Artistic, Social, Enterprising, and Conventional scales and 3-point codes of the Self-Directed Search may be considered statistically and practically equivalent across 3 different modes of administration: paper-and-pencil, personal computer, and Internet. Student preferences…

Three studies (N = 171) examined preschool children's tendency to use category information to make inferences about ambiguous behavior. Children heard stories in which category information about story characters was manipulated and behavioral information was held constant. Participants were asked to evaluate, explain, and determine the…